
Color Calibration Card
[->GitHub: Codes and MLOps Pipeline]
MLOps
ML
ETL
ETV
MTL
MRD
RandomForest
GBT
small neural network
MLOps
ML
ETL
ETV
MTL
MRD
RandomForest
GBT
small neural network
Map Processing
Path Planning
GUI Control
Voice Control
Q-learning
DQN
RL
CUDA
MQTT
ROS
React
Edge AI
Embedded Development
Gesture Recognition
AI Agent
AI Infra
RAG
Tool-augmented Reasoning
Prompt Engineering
Policy-Gradient Control
Actor-Critic
PPO
RL
ROS1
OpenCV
PID Control
ROS1
Linux
LiDAR
Reinforcement Learning
Monte Carlo ES
Computer Vision
ArUco Markers
Fiducials
OpenAI API
Prompt Engineering
Pygame
OSM
C++
A*
The Tianyuan Ichiban Lottery is a WeChat Mini Program offering anime figure lottery products via a digital platform system. Deployed in real market and attracted real users, the program generated over $15,000 in revenue.
This report applies Q-learning and DQN to Atari game Breakout (Gymnasium v5) using PyTorch, serving as an educational resource. (2025-05-06)
This report discusses how to use an AI Agent to finish a medical sepsis task and discussed the design of a simple AI agent. (2025-05-02)
This study uses ML tools to develop and validate a robust color calibration model that achieves precise color reproduction in a real-time MLOps system. (2025-03-14)
The study demonstrates how off-policy Monte Carlo control can learn an optimal racetrack policy and compares it with Monte Carlo methods in Blackjack.
This is a tiny-research that compares constant step-size method and sample-average method in nonstationary bandit problem.
This is a tiny-research that setting up a ten-armed bandit experiment and explore how different ε behave.
This is a tiny-research that extracting colors in HSV format and mark the centroid to achieve single color line following.
This is a tiny-research on maze escape solution. (2024-10-27)