About Me

Hi there! I'm Jeff Liu, a "program designer" who think CS is definetely art. After 3 years of work, I decided go back to school and embrace my passion on Computer Science. Now I am pursuing Master's degree in CS at Tufts, a very nice school.

I have a dream that one day, automated robots will handle all repetitive tasks, making the work much easier and allowing people have more time to relax! And I can't wait to see the digimon came alive in this fantastic era!

My interests include:
•   Theory Topics: AI Planning, Reinforcement Learning, Robotics
•   Applications: AI Applications and Model Deployment
•   Social Justice: AI Ethics, Income Equality in AI Era

Currently focus on two projects:
•   AI Financial Agent
- The Sub-module News-Agent (Global News) has already online, see demo via this link!
•   A.L.I.C.E. Project

Projects

Multi-Functional Cleaning Robot

This project has launched both in software and hardware fronts.  I build a turtlebot3 robot, with functions I am developing a smart cleaning robot with frontier-based exploration, path planning, route following and voice control. [->GitHub]
Map Processing Path Planning
GUI Control Voice Control
 

Value-based Reinforcement Learning Methods on Breakout Game

Explore designing and implementing value-based methods on breakout game. [->GitHub]
Q-learning DQN RL CUDA
 

IoT Platform (Collaborated Project)

This project builds a scalable IoT platform for real-time monitoring and control of diverse devices. Using MQTT and a Raspberry Pi hub, it supports remote setup, data display, and rule-based automation. With contributions from Aby Iberkleid, James Petullo, and Shubham Kaushik.
MQTT ROS React Edge AI
 
Fiducials Detection Demo

Smart Glove which can control Robot Arm

An AI-powered and raspberrypi-pico based smart glove that can control the robot arm. [->GitHub]
Embedded Development
Gesture Recognition
 
Fiducials Detection Demo

AI Agent on Sepsis Task

An AI Agent framework, desgined for seamless extension into domain-specific fields like Finance and Healthcare. See whole report in Research Notes section.
 [->GitHub]
AI Agent AI Infra RAG
Tool-augmented Reasoning
Prompt Engineering
 

Policy-based Reinforcement Learning Methods on Walker2d task

Explore designing and implementing policy-based methods on walker2d task. [->GitHub]
Policy-Gradient Control
Actor-Critic PPO RL
 

Following Line with Color-based Centroid Detection

This program can allow robot following a line and avoid obstacles.  The following logic is based on color and centroid detection. [->GitHub]
ROS1 OpenCV PID Control
 
Escape the Maze with Left Wall Following

Escape the Maze with Left Wall Following

This is my first project and designed at Brandeis Robotics lab.  This project is to escape the maze with left wall following algorithm. [->GitHub]
ROS1 Linux LiDAR
 

Solve Blackjack - Monte Carlo ES

The game blackjack was simulated 2 million times using the Monte Carlo ES method and converged to the optimal solution. [->GitHub]
Reinforcement Learning
Monte Carlo ES
 
Fiducials Detection Demo

Fiducials Detection

Implemented a real-time ArUco fiducial marker detection system using computer vision techniques. [->GitHub]
Computer Vision ArUco Markers Fiducials
 
Simple AI Agent Demo

Intelligent NPC Demo

This is the prototype or demo of project "Work With Farmer Louise". The NPC know nothing at first, all skills need to be learned from player. [->GitHub]
OpenAI API Prompt Engineering Pygame
 
A Star Demo

A* Route Planner

Use open source map to implement A* route plan.  The start position is Tufts University,  and the end point is in a park near Mystic River.  No Demo, See Source Codes:  [->GitHub]
OSM C++ A*
 

Ichiban Lottery (Commercial Project)

The Tianyuan Ichiban Lottery is a WeChat Mini Program offering anime figure lottery products via a digital platform system. Deployed in real market and attracted real users, the program generated over $15,000 in revenue.

Research Notes

Tutorials and Notebooks

DS&A Roadmap

This roadmap includes foundational data structures and algorithms, give you a clear study route that can learn and prepare for technique interviews.
Beyond this, the advanced algorithms are also attached and contain Codeforces or AtCoder links for those who attempt to participate in advanced algorithm competitions.
 

AI Notebook (Chinese Only)

Currently only support Chinese. This is a notebook containing AI foundational knowledges, including Artificial Intelligence, Machine Learning, Reinforcement Learning, and Deep Learning.
My first language is Chinese, so normally taking Chinese notes firstly. In view of the large amount and content of AI notes, I currently not consider translating them into English.