RL training
What a designer must do
- Define actions only in terms the real controller accepts [1].
- Give the policy only observations available on the real robot [2].
- Print the policy period and compare it with the hardware loop [3].
- Separate time-outs from failures, and bootstrap the critic at time-outs [4].
- Search for bugs before you tune hyperparameters [5].
- Derive each randomization range from real uncertainty [6].
- End any curriculum at the final deployment distribution [7].
- Keep one deterministic evaluation apart from randomized testing [8].
- Ship the checkpoint with its full params directory [9].
Scope: the guidelines on RL tasks and rewards, and on domain randomization. A policy can learn to exploit a solver or a model error [10], [11]. So design the task against the real robot's interface from the start [1].
Library choice
Library choice| Level | Library | What the guideline says | Doc as the guideline states it | Source |
|---|
| guide | RSL-RL | Start here for a new robotics project with no special need | Isaac Lab 3.0.0 docs, Reinforcement Learning | [12] |
| guide | RSL-RL | Core has PPO and student-teacher distillation. Other methods sit on its extras branch | RSL-RL README, main branch, captured 2026-11-08 | [13] |
| must | mjlab | Training needs an NVIDIA GPU. macOS works for evaluation only | mjlab README, main branch, MuJoCo Warp 3.16.0 badge, captured 2026-11-08 | [14] |
| guide | MuJoCo Playground | The captured main-branch README describes a PyTorch suite built on reaf-sim | MuJoCo Playground README, main branch, captured 2026-11-08 | [15] |
Two version traps show up here. The catalog's release records list MuJoCo Warp v4.0.0 on 2026-11-06, while the mjlab badge read 3.16.0 [14]. They also describe MuJoCo Playground v1.0.0 (2026-11-06) as built on MuJoCo MJX, which differs from the main branch README [15] and from the v1.0.0 README, which names PyTorch and reaf-sim (chapter 25). Pin versions and read the docs at that pin [16].
Your machines. Under the mjlab GPU guideline [14], the MacBook Air M5 can evaluate mjlab policies and the RTX 5090 PC is the training candidate. The guideline does not say whether Windows is supported for mjlab. The database has no part row for either machine. Isaac Lab lists Windows 11 on x86_64 [17], but multi-GPU training needs Linux [18] and the SO-101 typing workflow is Linux x86-64 only [19]. See chapter 25.
Task and episode
Freeze the episode definition early. Sim-to-sim transfer needs it unchanged [20].
Task and episode| Item | Requirement | Source |
|---|
| Reset | Reject robot-object and robot-support penetration before the first physics step | [21] |
| Reset under randomized geometry | Re-run the reset check on every geometry variant | [22] |
| Scene, SO-101 typing | Keep the keyboard fixed. The policy uses a fixed A–Z key map without camera input and cannot adjust to movement | [23] |
| Termination | Time-outs and failures are different flags | [4] |
| Non-finite state | On Isaac Lab PhysX backends, a newly imported robot without tuned parameters can go unstable, often sending NaNs into training. Consult the stability guide | [24] |
Actions and action scaling
Actions and action scaling| Level | Requirement | Check | Source |
|---|
| should | Actions match what the real controller can execute | review: each term maps to a real interface | [1] |
| guide | Legged RL: consider desired joint positions fed to a low-level PD loop. Rudin et al. used this form for ANYmal | review: term and PD gains documented | [25] |
| guide | Action representation is a design choice to test. Local feedback in higher-level actions can strongly affect learning and robustness | sim: same task with two action forms | [26] |
| should | Tune scale per task, smaller for contact-rich work | sim: sweep scale, log success and smoothness | [27] |
| should | Set scale with control rate in view. The gear task notes that a higher rate allows larger steps | review: scale and rate noted together | [28] |
| guide | 0.025 is the action scale of the UR10e and Rizon 4s gear task, not a general value | review: a copied scale gets its own sweep | [29] |
Apply the same policy-output post-processing during real-world inference as in Isaac Lab [30]. During transfer, keep targets short of the hard joint stops [31].
Observations
Observations| Level | Requirement | Check | Source |
|---|
| must | Only observations available on the real robot | review: each maps to a sensor or estimator | [2] |
| should | Simulation-only dynamics parameters go to the critic only | review: actor group has no privileged term | [32] |
| should | Model sensor noise and delay where they matter | measure: compare hardware and simulated noise | [33] |
| must | Adding noise never changes tensor shape or order | lint: names, shape and order match in training and deployment | [34] |
| guide | Consider a history of observations and actions when hidden dynamics must be inferred | sim: with and without history | [35] |
Rates
Rates| Level | Requirement | Check | Source |
|---|
| must | Policy period is SimulationCfg.dt times env.decimation. Substeps do not change it | lint: print it, compare with the hardware loop | [3] |
| guide | 50 Hz is one published legged reference, not a universal rate | measure: real policy loop rate and jitter | [36] |
| guide | Confirm the compute target holds the rate. Mini Cheetah held 50 Hz on a Jetson TX2 NX | measure: inference loop time on the target | [37] |
Do not change decimation to hide an unstable physics step [38].
Rewards
Rewards| Level | Requirement | Check | Source |
|---|
| must | PPO: treat time-outs differently from failures. Bootstrap the critic target at time-outs | review: code separates the two flags | [4] |
| should | Check that your library handles this. The Rudin paper found it often ignored | review: read the bootstrap code | [39] |
| should | Legged sim-to-real: add auxiliary rewards. Walk These Ways states that task reward alone has not been shown to transfer | sim: gait metrics with and without | [40] |
| should | Penalize torque, joint acceleration, target change and unwanted collisions for smoother legged motion | sim: log each term against task reward | [41] |
| guide | Consider an action-rate penalty to promote smooth motion, as used in the gear assembly task | sim: log the term and sign changes | [42] |
| guide | Insertion: pair a distance reward with a dense exponential term near alignment | sim: final error with and without | [43] |
| guide | The Rizon 4s gear task linearly ramps its grasp reward weight from zero so the policy first learns coarse behaviour. The config shows 250,000 steps, while the prose says 512k | sim: plot weight against steps | [44] |
Batch and curriculum
Batch and curriculum| Level | Requirement | Check | Source |
|---|
| should | Do not drop PPO steps per environment too low. ANYmal training struggled below 25 steps, or 0.5 s of simulated time | sim: sweep against reward | [45] |
| should | Changing the environment count changes samples per update, so it is a training change | review: run config records both | [46] |
| should | Consider a curriculum that adapts difficulty to policy performance | sim: log level against reward | [47] |
| guide | Do not rely on a hand-written curriculum when feasibility is unknown | review: a measurement backs it | [48] |
| must | The curriculum ends at the final deployment distribution. Evaluate there | sim: final stage, full gravity, full ranges | [7] |
| should | Easier physics such as low gravity is a start only. Zero gravity is not the deployment condition | sim: final evaluation uses full gravity | [49] |
Domain randomization: method
Domain randomization: method| Level | Requirement | Check | Source |
|---|
| should | Ranges span plausible modeling uncertainty, not arbitrary width | measure: each range cites a measurement or tolerance | [6] |
| should | If transfer works only with extreme ranges, go back to the nominal model and what the policy exploits | review: range growth triggers a model review | [11] |
| should | Cover real variation without blocking learning. Wider ranges make training harder | sim: success against range width | [50] |
| guide | Pick terms by asking what actually changes on the real robot and around it | review: each term names its cause | [51] |
| should | Combine identification with randomization. Hwangbo notes each alone has a cost | review: the plan names both | [52] |
| should | With ADR, start from calibration values measured on the robot | measure: record them first | [53] |
| guide | Consider ADR when manual ranges are hard to choose | sim: log range boundaries | [54] |
Domain randomization: keep it physical
Domain randomization: keep it physical| Level | Requirement | Check | Source |
|---|
| must | Inertia stays positive and consistent. Decide whether a mass change recomputes inertia | sim: assert for every sampled body | [55] |
| must | Armature ranges stay positive and within what hardware supports. Linked mechanisms vary together | lint: range minimum above zero | [56] |
| must | Each geometry variant gets its own reset collision check | sim: on each sampled size | [22] |
| must | PhysX friction randomization does not carry over. Newton events use one coefficient | review: defined per backend | [57] |
Domain randomization: which terms
Domain randomization: which terms| Level | Term | Source context | Check | Source |
|---|
| guide | Link mass, joint damping, controller gains, action timestep, observation noise | Peng, 95 parameters, arm pushing | review: compare your list | [58] |
| guide | Physical terms fixed per episode; action timestep and observation noise vary per step | Peng | review: event mode matches physics | [59] |
| should | Time between actions, as a simple latency model | Peng | measure: real latency sets the range | [60] |
| guide | Memory-based policy when dynamics are unknown | Peng | sim: recurrent against feedforward | [61] |
| should | Ground friction, observation noise, pushes | ANYmal | sim: push recovery at friction extremes | [62] |
| should | Observation noise based on data measured on the robot | ANYmal | measure: idle sensor spread | [63] |
| guide | Camera pose and FOV, lighting, object size, object friction, gripper closing speed | Squint, SO-101 | sim: disable each term once, test real success | [64] |
| should | Actuator gain and joint friction where the real robot shows stiction. Needed on UR10e, not on Rizon 4s | Isaac Lab gear task | measure: step response, steady-state error | [65] |
| guide | Gear tasks: policies trained without proprioceptive noise transferred well. The authors say UR10e joint feedback is accurate enough that modeling the noise does not help | Isaac Lab gear task | measure: encoder against external reference | [66] |
| should | Pose-observation noise calibrated to the real perception pipeline | Isaac Lab gear task | measure: perceived against true pose | [67] |
| should | Vision: test wide rendering variation rather than photorealism | Tobin, object localization | measure: error on real images | [68] |
| guide | Treat "reality is another sample" as a hypothesis for one task class | Tobin | measure: run the real task | [69] |
Published values: do not copy
Each number belongs to one robot and one source [29], [70]. Use it to sanity-check a design, not to fill a config. Whole shipped configs, with PPO settings and reward weights, are in RL configs that ship.
Published values: do not copy| System | Item | Value | Source |
|---|
| UR10e, Rizon 4s | Action scale | 0.025 | [29] |
| SO-101, Squint | Deployment action scale | 0.15 | [71] |
| ANYmal | Minimum steps per environment | 25 steps, 0.5 s | [45] |
| Rizon 4s | Grasp reward ramp | 250,000 steps in the config, 512k in the prose | [44] |
| Arm pushing | Randomized parameters | 95 | [58] |
| Mini Cheetah | Ground friction | 0.05 to 4.00 | [72] |
| Mini Cheetah | Payload | -1.0 to 3.0 kg | [70] |
| Mini Cheetah | Motor strength | 90 to 110 percent | [73] |
| ANYmal | Friction | 0.5 to 1.25 | [74] |
| SO-101, Squint | Joint position noise | Sigma 5. The sentence states no unit | [75] |
| Object localization | Detector accuracy | 1.5 cm | [68] |
Debug and evaluate
Debug and evaluate| Level | Requirement | Check | Source |
|---|
| should | Broken RL code often fails silently. Search for bugs before tuning | review: test against a simple solved task | [5] |
| should | Debug on a simple environment where learning should be quick | sim: benchmark task first | [76] |
| should | Log many statistics each iteration | sim: reward terms, losses, action statistics | [77] |
| should | One evaluation with no randomization and fixed seeds | sim | [8] |
| should | Evaluate between stages. A published update count is not a guaranteed budget | sim: store results per stage | [78] |
| should | Keep the checkpoint with its complete params/ directory | review: release bundle holds both | [9] |
On the SO-101
This table holds published settings from one paper, Squint, in ManiSkill3 [79], plus the Isaac Lab typing project [80]. Shipped configs from Isaac Lab v3.0.0, NVIDIA's typing project and MuJoCo Playground v1.0.0 are compared in RL configs that ship.
On the SO-101| Item | Published setting | Source |
|---|
| Training control | 10 Hz, PD joint delta position | [79] |
| Deployment | Action scale 0.15, 30 Hz | [71] |
| Randomized terms | Squint's vision terms, in the term table above | [64] |
| Isaac Lab runtime | Typing project's pinned, patched 3.0.0-based runtime | [80] |
| Calibration | Your own. Released offsets do not calibrate your robot | [81] |
Before you randomize, measure the servo: backlash, step response and encoder accuracy. The backlash, stiction and joint-noise guidelines ask for these checks [82], [65], [66]. One bench test of the STS3215-C018 found about 1 deg of backlash against a datasheet value of at most 0.5 deg [82].
Where the database is thin
- No guideline gives a general learning rate, discount value, entropy setting or network size. The guidelines on shipped RL configs give RSL-RL's defaults and shipped values, as working examples only. See chapter 26.
- One project reports 2 h 38 min 21 s on an RTX 5090, at 36.72 s per 10 updates with 4096 environments [83], [84]. That is one run of one task. Nothing here predicts your run time.
- SO-101 reward weights exist only for shipped tasks, such as typing [85] and pick-cube [86].
- No guideline comes from the Isaac Sim docs host, which stays held. The Isaac Sim guidelines come from the repo at tag v6.2.0, mostly from agent-written notes. See chapter 25.
Sources
Each guideline in this chapter with its source, the date it was read and the exact words of the source. Level: must means breaking it causes failure or harm, should is good practice, guide is a rule of thumb.
- Define policy actions only in terms that the real controller accepts. Level: should. isaac-sim.github.io 2026-11-08“Your action space should match what the real robot controller can execute.”
- Give the policy only observations that are available on the real robot. Level: must. isaac-sim.github.io 2026-11-08“The observation space should only include information available from real sensors”
- Compute the policy period as SimulationCfg.dt times env.decimation; substeps do not change it. Level: must. isaac-sim.github.io 2026-11-08“Substeps do not change the policy period”
- In PPO, treat time-outs differently from failures, and bootstrap the critic target at time-outs. Level: must. arxiv.org 2026-11-08
- When RL fails, search for bugs before tuning hyperparameters, as broken RL code often fails silently. Level: should. spinningup.openai.com 2026-11-08
- Derive each randomization range from how uncertain the model really is; do not widen ranges without a reason. Level: should. isaac-sim.github.io 2026-11-08“Domain randomization should span plausible modeling uncertainty, not arbitrarily wide values.”
- Make any curriculum end at the final deployment distribution, and evaluate there. Level: must. isaac-sim.github.io 2026-11-08“the curriculum must promote to the final deployment distribution.”
- Run one evaluation with no randomization and fixed seeds, kept apart from randomized testing, so sampling noise cannot hide differences. Level: should. isaac-sim.github.io 2026-11-08“Keep a separate deterministic nominal evaluation”
- Ship a checkpoint together with its full params directory, as playback, evaluation and deployment all need it. Level: should. isaac-sim.github.io 2026-11-08“Keep the checkpoint’s complete params/ directory for playback, evaluation and deployment.”
- Raise damping when a position policy alternates saturated commands to exploit one solver's response. Level: should. isaac-sim.github.io 2026-11-08“Increased damping is often necessary to prevent bang-bang control.”
- If transfer works only with extreme ranges, go back to the nominal model and to what the policy exploits. Level: should. isaac-sim.github.io 2026-11-08“revisit the nominal model and the feature the policy is exploiting.”
- For a new robotics project with no special need, start with RSL-RL under Isaac Lab 3.0.0. Level: guide. isaac-sim.github.io 2026-11-08“start with RSL-RL.”
- Use RSL-RL core for PPO and student-teacher distillation; other methods sit on its extras branch. Level: guide. raw.githubusercontent.com 2026-11-08
- Plan on an NVIDIA GPU for mjlab training; macOS works for evaluation only. Level: must. raw.githubusercontent.com 2026-11-08“mjlab requires an NVIDIA GPU for training. macOS is supported for evaluation only.”
- The captured main-branch MuJoCo Playground README describes a PyTorch suite built on reaf-sim. Level: guide. raw.githubusercontent.com 2026-11-08“written in [PyTorch](https://pytorch.org/) and built on [`reaf-sim`]”
- Have agents read docs at the pinned simulator version, because the Isaac Lab 3.0.0 project notes that compatibility with later releases has not been validated. Level: must. isaac-sim.github.io 2026-11-08“or later versions has not been validated.”
- Supported platforms are Ubuntu 22.04 or later on x86_64, Linux aarch64 including DGX Spark, and Windows 11 on x86_64. Level: must. raw.githubusercontent.com 2026-11-09“- Ubuntu 22.04+ on x86_64, Linux aarch64 (including DGX Spark), or Windows 11 on x86_64.”
- Multi-GPU and multi-node training need Linux and NVIDIA NCCL; Windows is not supported. Level: must. raw.githubusercontent.com 2026-11-09“Multi-GPU and multi-node training requires Linux and NVIDIA NCCL. Windows is not supported.”
- The documented SO-101 typing workflow supports Linux x86-64 only; Windows and ARM are not validated. Level: must. raw.githubusercontent.com 2026-11-09“The documented workflow supports **Linux x86-64 only**. Windows and ARM have not been validated for this project.”
- Keep the episode definition the same between backends: how resets and commands are sampled, what rewards and terminations mean, episode length and the success test. Level: must. isaac-sim.github.io 2026-11-08“Reset and command distributions, reward and termination meanings, horizon, and success”
- Reject resets with robot-object or robot-support penetration before the first physics step. Level: must. isaac-sim.github.io 2026-11-08“Reject robot-object and robot-support penetration, impossible mimic states, and invalid randomized geometry before the first physics step.”
- Each sampled geometry variant needs its own check that reset states are free of collisions. Level: must. isaac-sim.github.io 2026-11-08“Re-run collision-valid reset checks for every geometry variant.”
- Keep the SO-101 typing keyboard fixed: its policy uses a fixed A–Z key map without camera input and cannot adjust to movement. Level: must. isaac-sim.github.io 2026-11-08“it cannot adjust to a moved keyboard.”
- On Isaac Lab PhysX backends, a newly imported robot without tuned parameters can go unstable, often sending NaNs into RL training; consult the stability guide. Level: should. isaac-sim.github.io 2026-11-08“this will often result in NaNs propagating into the learning pipeline”
- For legged RL, consider desired joint positions fed to a low-level PD loop; Rudin et al. used this form for ANYmal. Level: guide. arxiv.org 2026-11-08
- Treat action representation as a design choice to test, because local feedback in higher-level actions can strongly affect learning and robustness. Level: guide. arxiv.org 2026-11-08
- Tune action scale per task: smaller for contact-rich work, with control rate in mind. Level: should. isaac-sim.github.io 2026-11-08“Task precision requirements (smaller for contact-rich tasks)”
- Set action scale with the control rate in view; the gear task notes that a higher rate allows larger steps. Level: should. isaac-sim.github.io 2026-11-08“Control frequency (higher frequency allows larger steps)”
- Treat 0.025 as the action scale of the UR10e and Rizon 4s gear task, not as a general value. 0.025 action scale Level: guide. isaac-sim.github.io 2026-11-08“self.joint_action_scale = 0.025”
- Apply the same policy-output post-processing during real-world inference as in Isaac Lab. Level: must. isaac-sim.github.io 2026-11-08“is also applied during real-world inference”
- During policy transfer, stop targets short of the hard limits of each joint. Level: should. isaac-sim.github.io 2026-11-08“keep targets away from hard joint stops”
- Pass simulation-only dynamics parameters to the critic only, not to the deployed policy. Level: should. arxiv.org 2026-11-08
- Model sensor noise and delay in the observations where they matter for the robot. Level: should. isaac-sim.github.io 2026-11-08“Sensor noise and delays should be modeled appropriately”
- Keep observation tensor shape and order fixed when you add noise. Level: must. isaac-sim.github.io 2026-11-08“Match a plausible sensor and never change tensor shape or ordering.”
- Consider a history of past observations and actions as policy input when hidden dynamics must be inferred. Level: guide. arxiv.org 2026-11-08
- Use 50 Hz as one published legged reference, not a universal rate; Rudin et al. ran policies at this rate. 50 Hz Level: guide. arxiv.org 2026-11-08
- Confirm the compute target can hold the policy rate; the Mini Cheetah work held 50 Hz on an onboard Jetson TX2 NX. 50 Hz Level: guide. arxiv.org 2026-11-08
- Keep policy decimation out of stability fixes; if the physics step is unstable, fix the physics. Level: must. isaac-sim.github.io 2026-11-08“Do not change policy decimation merely to conceal an unstable physics step.”
- Check that your RL library handles time-outs, because the Rudin paper found this often ignored in popular code at the time. Level: should. arxiv.org 2026-11-08
- For legged sim-to-real, add auxiliary rewards; the Walk These Ways authors state that task reward alone has not been shown to transfer. Level: should. arxiv.org 2026-11-08
- Penalize torque, joint acceleration, target change and unwanted collisions for smoother legged motion. Level: should. arxiv.org 2026-11-08
- Consider an action-rate penalty to promote smooth motion, as used in the gear assembly task. Level: guide. isaac-sim.github.io 2026-11-08“Penalizes large changes in actions between timesteps, promoting smooth motions.”
- For insertion, pair a distance reward with a dense exponential term that grows sharply near alignment. Level: guide. isaac-sim.github.io 2026-11-08“Provides a dense exponential reward that grows sharply as keypoints align”
- The Rizon 4s gear task linearly ramps its grasp reward weight from zero so the policy first learns coarse behavior; the config shows 250,000 steps, while the prose says 512k. 512k environment steps Level: guide. isaac-sim.github.io 2026-11-08“linearly ramps the reward weight from zero over the first 512k environment steps”
- Do not drop PPO steps per environment too low; ANYmal training struggled below 25 steps, or 0.5 s of simulated time. 25 steps Level: should. arxiv.org 2026-11-08
- Treat a change in parallel environment count as a training change, because it changes samples per update. Level: should. isaac-sim.github.io 2026-11-08“this also changes the number of samples per training update.”
- Consider a curriculum that automatically adapts task difficulty to policy performance. Level: should. arxiv.org 2026-11-08
- Do not rely on a hand-written curriculum when task feasibility is unknown. Level: guide. arxiv.org 2026-11-08
- Use easier physics such as low gravity only as a curriculum start, because zero gravity is not the deployment condition. Level: should. isaac-sim.github.io 2026-11-08“Zero gravity is not the deployment condition.”
- Randomize enough to cover real variation without blocking learning, as wider ranges make training harder. Level: should. isaac-sim.github.io 2026-11-08“Increasing randomization ranges makes it harder for the policy to learn”
- Pick randomization terms by asking what actually changes on the real robot and around it. Level: guide. docs.nvidia.com 2026-11-08
- Combine identification with randomization; Hwangbo notes that accurate modeling is cumbersome alone and robustness alone can cost performance. Level: should. arxiv.org 2026-11-08
- For ADR policy training, start with the calibrated physical-robot environment, then expand as performance improves. Level: should. arxiv.org 2026-11-08
- Consider ADR when manual fixed ranges are hard to choose, as it expands a distribution over environments where the model performs well. Level: guide. arxiv.org 2026-11-08
- Keep inertia positive and physically consistent when you randomize mass, and decide whether mass changes recompute inertia. Level: must. isaac-sim.github.io 2026-11-08“Decide explicitly whether changing mass recomputes inertia.”
- Armature randomization must stay positive and within what the hardware supports, and linked mechanisms must vary together. Level: must. isaac-sim.github.io 2026-11-08“Use positive, physically supported ranges and randomize coupled mechanisms coherently.”
- Do not assume PhysX friction randomization carries over: Newton events use one friction coefficient, and PhysX values and buckets do not map one-to-one. Level: must. isaac-sim.github.io 2026-11-08“PhysX static/dynamic values and buckets do not map one-to-one.”
- For arm dynamics randomization, consider link mass, joint damping, controller gains, action timestep and observation noise, as in Peng's 95-parameter pushing setup. 95 parameters Level: guide. arxiv.org 2026-11-08
- Hold physical parameters constant within an episode, and vary action timestep and observation noise at every step, when you follow Peng's method. Level: guide. arxiv.org 2026-11-08
- Randomize the time between actions as a simple model of controller latency. Level: should. arxiv.org 2026-11-08
- Consider a memory-based policy when the policy must adapt to unknown dynamics. Level: guide. arxiv.org 2026-11-08
- Add ground friction randomization, observation noise and pushes for legged sim-to-real, as the ANYmal work did. Level: should. arxiv.org 2026-11-08
- Base observation noise on data measured on the robot. Level: should. arxiv.org 2026-11-08
- For SO-101 vision tasks, consider camera pose and FOV, lighting, object size, object friction and gripper closing speed, as Squint randomized. Level: guide. arxiv.org 2026-11-08
- Add actuator gain and joint friction randomization where the real robot shows stiction; the gear task needed it on UR10e and not on Rizon 4s. Level: should. isaac-sim.github.io 2026-11-08“with negligible stiction and steady-state error.”
- For the gear tasks, policies trained without proprioceptive noise transferred well; the authors say UR10e joint feedback is accurate enough that modeling the noise does not help. Level: guide. isaac-sim.github.io 2026-11-08“policies trained without noise on proprioceptive observations (joint positions and velocities) transfer well to real hardware.”
- Calibrate pose-observation noise to the real perception pipeline's error. Level: should. isaac-sim.github.io 2026-11-08“Vision-based observations with noise calibrated to FoundationPose + RealSense D435 error”
- For vision, test wide rendering variation rather than photorealism; Tobin's detector reached 1.5 cm for object localization with non-realistic textures. 1.5 cm Level: should. arxiv.org 2026-11-08
- Treat the claim that enough variation makes reality another sample as a tested hypothesis for one task class, and verify it on yours. Level: guide. arxiv.org 2026-11-08
- Treat a -1.0 to 3.0 kg payload range as the Mini Cheetah value only, scaled to no other robot without a reason. -1.0 to 3.0 kg Level: guide. arxiv.org 2026-11-08
- On a first SO-101 transfer, consider scaling actions down and raising control rate at deployment; Squint used 0.15 and 30 Hz and reports smoother paths. 0.15 action scale Level: guide. arxiv.org 2026-11-08
- The Mini Cheetah paper randomizes ground friction from 0.05 to 4.00. 0.05-4.00 friction coefficient Level: guide. arxiv.org 2026-11-08
- Consider randomizing motor strength; the Mini Cheetah work used 90-110 percent. 90-110 % Level: guide. arxiv.org 2026-11-08
- Treat a uniform 0.5-1.25 friction range as the ANYmal value from one paper. 0.5-1.25 friction coefficient Level: guide. arxiv.org 2026-11-08
- Consider joint-position noise to absorb sim-to-real joint mismatch; Squint uses sigma = 5 without stating its unit in that sentence. 5 unit not stated in sentence Level: guide. arxiv.org 2026-11-08
- Debug a new RL implementation on a simple environment where learning should be quick. Level: should. spinningup.openai.com 2026-11-08
- Log many learning statistics at each iteration, or you will not see that training is broken. Level: should. spinningup.openai.com 2026-11-08
- Evaluate between training stages, and do not treat a published update count as a guaranteed budget. Level: should. isaac-sim.github.io 2026-11-08“this is not a guaranteed minimum.”
- Treat 10 Hz delta joint position control as Squint's SO-101 training setting, chosen for faster training. 10 Hz Level: guide. arxiv.org 2026-11-08
- Use the SO-101 typing project's pinned Isaac Lab runtime, because unmodified 3.0 GA or later is not validated. Level: must. isaac-sim.github.io 2026-11-08“Compatibility with unmodified 3.0 GA or later versions has not been validated.”
- Calibrate each SO-101 before running a policy; another setup's released offsets do not calibrate your robot. Level: must. isaac-sim.github.io 2026-11-08“they do not calibrate another robot.”
- A bench test of the STS3215 measured about 1° of encoder backlash against a ≤0.5° datasheet value. Level: guide. github.com 2026-11-08
- The measured training and evaluation wall time was 2 h 38 min 21 s on an RTX 5090; use it as one planning point. Level: guide. raw.githubusercontent.com 2026-11-09“Its measured training/evaluation wall time was **2 h 38 min 21 s** on an RTX 5090.”
- The measured rate was 36.72 s per 10 updates with 4096 environments. Level: guide. raw.githubusercontent.com 2026-11-09“At the measured 36.72 seconds per 10 updates with 4096 environments”
- The SO-101 keyboard typing reward gives typing progress a weight of 2.0. 2.0 Level: guide. raw.githubusercontent.com 2026-11-09“typing_progress = RewTerm(func=mdp.letter_typing_progress, weight=2.0, params={"command_name": "typing"})”
- The Playground SO-101 task weights the grasp reward at 1.5 with open 0.80, closed 0.15 and reaching std 0.025. Level: guide. raw.githubusercontent.com 2026-11-09“open_pos=0.80, closed_pos=0.15, reaching_std=0.025, weight=1.5,”