What is Numen?

Numen is an embodied agent that runs inside Minecraft. With a large language model as its mind and a real player entity as its body, it lives in the game as a mod, shares the same world with you, and keeps exploring, making its own decisions, and taking action to get tasks done.

Why I Made It

Great research such as Voyager showed me what large models could do in Minecraft, but most of it is built on Mineflayer and needs players to set up Node.js or Python locally. From a product point of view, that is a high bar for everyday players. (Yes, the reason really is that simple Ovo)

Before the AI wave, I had made a few mods, such as the Chiikawa fan-made mod; then AI made me far more productive as a developer. And so Numen was born.

I want it to be just a mod: download, launch, and it works, with no extra environment to set up. I also want it to be able to do everything a player can do, including getting the most out of other mods!

About This Site

This site has three parts:

• Introduction: what Numen is, how to install it and how to get started, for all players.
• Development: for developers who want to extend Numen with plugins, showing how to register new abilities with it.
• Deep Dive: Numen's inner workings explained module by module, helping players and developers understand how it thinks and acts, along with some lessons and pitfalls from the road of building it.

Acknowledgements

Thanks to every player who has downloaded it, tried it out or left a comment. Many of Numen's changes came from a single piece of feedback from you in the comments, in Issues or in our group chats. Thanks also to everyone who patiently described their problems, sometimes even attaching logs; you saved me from many detours.

Thanks to everyone who has contributed code, testing and translations to Numen, and to everyone who has raised issues and suggestions on GitHub. There is only so much one person can do; you are what brought it this far.

Numen stands on the shoulders of many projects and studies before it, and they will be introduced one by one in Deep Dive.

Finally, thank you for reading this far. I hope it keeps you company for some fun times in the world of blocks.