SAC

E426679

SAC (Soft Actor-Critic) is a popular off-policy deep reinforcement learning algorithm that optimizes both expected return and policy entropy to achieve stable and efficient learning in continuous control tasks.

All labels observed (1)

Label Occurrences
SAC canonical 4

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf deep reinforcement learning algorithm ⓘ
deep reinforcement learning algorithm ⓘ
off-policy reinforcement learning algorithm ⓘ
off-policy reinforcement learning algorithm ⓘ
abbreviation SAC ⓘ
advantageOverDeterministicMethods better exploration via entropy maximization ⓘ
aimsFor sample-efficient learning ⓘ
stable learning ⓘ
canBe model-free ⓘ
category actor-critic methods ⓘ
commonlyEvaluatedOn MuJoCo benchmarks ⓘ
linked to: MuJoCo environments

OpenAI Gym continuous control tasks ⓘ
comparedWith DDPG ⓘ
TD3 ⓘ
criticUpdateBasedOn soft Bellman backup ⓘ
firstPublishedIn "Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor" ⓘ
fullName Soft Actor-Critic ⓘ
hasVariant automatic entropy tuning SAC ⓘ
discrete SAC ⓘ
implementedIn PyTorch ⓘ
TensorFlow ⓘ
introducedIn 2018 ⓘ
is maximum entropy reinforcement learning method ⓘ
laterExtendedIn "Soft Actor-Critic Algorithms and Applications" ⓘ
linked to: Soft Actor-Critic
learningSignal temporal-difference error ⓘ
objectiveIncludes temperature parameter ⓘ
optimizationObjective expected return ⓘ
policy entropy ⓘ
policyOutput distribution over continuous actions ⓘ
policyType stochastic policy ⓘ
policyUpdateBasedOn reparameterization trick ⓘ
proposedBy Aurick Zhou ⓘ
Pieter Abbeel ⓘ
Sergey Levine ⓘ
Tuomas Haarnoja ⓘ
sampleEfficiency high ⓘ
supports continuous action spaces ⓘ
temperatureParameterControls entropy-returns trade-off ⓘ
trainingStability high ⓘ
typicalDomain continuous control tasks ⓘ
updateStyle off-policy updates ⓘ
usedIn autonomous driving research ⓘ
manipulation tasks ⓘ
robotics control ⓘ
uses actor-critic architecture ⓘ
entropy regularization ⓘ
replay buffer ⓘ
target networks ⓘ
valueFunctionType soft Q-function ⓘ

How these facts were elicited

Referenced by (4)

Full triples — surface form annotated when it differs from this entity's canonical label.

Soft Actor-Critic → abbreviation → SAC ⓘ
subject linked to: SAC