A glowing hot steel slab passing through rolling-mill cylinders, ember heat against steel machinery

Case 05 · control

Rolling Steel by Reinforcement

REINFORCEMENT LEARNING · PROCESS CONTROL

2020 · RWTH Cybernetics Lab IMA & IfU

Hot rolling is a control problem with real thermodynamics. I applied state-of-the-art reinforcement learning to optimize the process on simulations compatible with Gym.

I also built the plumbing: a RESTful FastAPI server logging every simulation into an ArangoDB graph database, as submitted by the client API.

Half research, half engineering — the half-and-half I keep returning to.

apparatus

  • Reinforcement Learning
  • Gym
  • FastAPI
  • ArangoDB
Revan · ML Engineer · Darmstadt
σ 0.430
00%initializing
finding the structure in the noise
Revan