← 返回首页

强化学习

Reinforcement Learning

课程介绍 Course Introduction

学分:3 | 先修课:机器学习导论、概率论与数理统计 | 学期:第6学期

强化学习研究智能体通过与环境交互、试错优化策略以最大化累积回报的学习范式。课程内容包括马尔可夫决策过程、值迭代与策略迭代、蒙特卡洛方法、时序差分学习(Q-Learning、SARSA)、Deep Q-Network、策略梯度方法(REINFORCE、PPO)、Actor-Critic框架及多智能体强化学习。学生将掌握序列决策的核心算法,应用于游戏AI、机器人控制、推荐系统等场景。

Reinforcement Learning studies how agents learn optimal policies through environment interaction and trial-and-error to maximize cumulative reward. Topics include Markov decision processes, value and policy iteration, Monte Carlo methods, temporal difference learning (Q-Learning, SARSA), Deep Q-Network, policy gradient methods (REINFORCE, PPO), Actor-Critic frameworks, and multi-agent RL. Students master sequential decision-making algorithms applicable to game AI, robotic control, and recommender systems.

大作业 Final Project

作业标题:游戏AI智能体策略学习与优化 / Game AI Agent Strategy Learning and Optimization

选择经典游戏环境(如CartPole、Atari或围棋),实现DQN、PPO或Actor-Critic等强化学习算法,训练智能体掌握最优策略。提交训练代码、学习曲线分析及智能体演示视频。

Select a classic game environment (e.g., CartPole, Atari or Go), implement RL algorithms such as DQN, PPO or Actor-Critic, and train the agent to master optimal strategies. Submit training code, learning curve analysis, and agent demo video.

实施步骤 Implementation Steps

📋 示例:选一个游戏环境来训练AI,比如CartPole平衡杆或者Atari打砖块。你需要自己搭建强化学习模型(比如DQN),让AI通过不断试错学会玩游戏,然后画出学习曲线,看看它用了多少轮才能稳定通关。
步骤 1
环境建模
设计强化学习环境,定义状态、动作和奖励函数
产出:环境设计文档
步骤 2
算法选择
选择Q-learning、DQN等算法,设计网络结构
产出:算法设计文档
步骤 3
模型训练
实现强化学习算法,训练智能体
产出:训练好的模型
步骤 4
效果评估
评估智能体在测试环境中的表现
产出:评估报告
步骤 5
报告提交
整理实验报告和代码注释
产出:最终提交材料

Steps

Step 1
Environment Modeling
Design RL environment, define state, action, reward
Deliverable: Environment Design Doc
Step 2
Algorithm Selection
Select Q-learning, DQN, design network architecture
Deliverable: Algorithm Design Doc
Step 3
Model Training
Implement RL algorithm, train agent
Deliverable: Trained Model
Step 4
Evaluation
Evaluate agent performance in test environment
Deliverable: Evaluation Report
Step 5
Report Submission
Prepare experimental report and code comments
Deliverable: Final Submission

Prerequisites · International Exams · Contact · Back to top · Home