vmoens (@VincentMoens) / X

vmoens

597 posts

vmoens

@VincentMoens

Member of tech staff @PeriodicLabs TorchRL maintainer (@torchrl1) at PyTorch. Neuroscience PhD, ex-M.D.

London, England

Joined July 2015

vmoens
@VincentMoens
Dec 7, 2024
Internship offer! We’re looking for an intern (research scientist/PhD) to join the #PyTorch team at Meta this summer. The work involves GPU kernel generation using LLM 👇
62K
vmoens
@VincentMoens
Sep 19, 2024
Today we're opensourcing a LeanRL, a simple RL library that provides recipes for fast RL training using torch.compile and cudagraphs. Using these, we get >6x speed-ups compared to the original CleanRL implementations. github.com/pytorch-labs/l… A thread ⬇️
89K
vmoens
@VincentMoens
Sep 30, 2024
Saying that RL is dead, uncool or sinking is missing the point RL folks know how to deal with sequential data, they know how to plan, simulate, bootstrap, cache future values or build dynamic datasets. You'll all need an "RL person" at some point, like it or not
10K
vmoens
@VincentMoens
Sep 25, 2024
Stoked to announce that BricksRL, our paper on using PyTorch/TorchRL to train the LEGO® robots in the wild has been accepted at @NeurIPSConf as a spotlight paper! 🪢
19K
vmoens
@VincentMoens
Jul 1, 2024
Personal update: After 3y at Meta ... I'm staying right here, but transitioning to PyTorch core. Keep calm, I'll keep on maintaining TorchRL but will also bring some (hopefully) cool features to the broader community & focus on github.com/pytorch/tensor… maintenance and dev.
GitHub - pytorch/tensordict: TensorDict is a pytorch dedicated tensor container.
From github.com
12K
vmoens
@VincentMoens
Jul 30, 2024
I'm excited to announce the release of the latest version of TensorDict! 📚 -> 📓 It introduces `TensorDict.consolidate`, a powerful feature that groups all of your tensors under a single storage unit, regardless of their dtypes!
5.6K
vmoens
@VincentMoens
Dec 7, 2024
Replying to @VincentMoens
More info here: metacareers.com/jobs/604446355… The position is based in NYC. DM me if interested!
5.2K
vmoens
@VincentMoens
Aug 3, 2024
A library can only be as good as its doc is. It took me some time but I finally updated the TensorDict Getting Started, check it out here: github.com/pytorch/tensor… Hope you'll find some gems in there!
1.7K
vmoens
@VincentMoens
Dec 14, 2024
Check out Motivo, a behavioral foundation model for humanoid control by FAIR. It's a one-of-its-kind unsupervised RL project, and it comes with a demo that is SO fun to play with! metamotivo.metademolab.com (for the record, they use compile and cudagraphs!)
00:00
4.4K
vmoens
@VincentMoens
Nov 4, 2023
Offline RL and IL are getting more popular by the day! However, we still don't have a hub to find datasets with a conventional format... Help us build one!
torchrl
@torchrl1
Nov 4, 2023
Want to help build an offline RL dataset hub? We're looking for contributors to integrate more datasets within torchrl.data More details in 🧵
5.5K
vmoens
@VincentMoens
Oct 18, 2024
I will never forgive whoever thought that "vectorized environments" was a good name for "parallel/multiprocessed environments". Now that we really have vectorized environments everything has become so confusing...
868
vmoens
@VincentMoens
Nov 4, 2024
AI is getting out of c... No i'm kidding But now that I have your attention, let me show you The One and Only TensorDict Cheat Sheet You've Been Dreaming Of! 1/n✍
2.1K
vmoens
@VincentMoens
Jun 11, 2024
Replying to @NoContextBrits
1.2K
vmoens
@VincentMoens
Oct 21, 2024
Just released tensordict v0.6.0. The main feature of this release is that the package is now compatible with torch.export: you can basically write an entire tensordict workflow and deploy it later on *without* explicitly depending on tensordict lib! 👇
853