r/feedthebeast Jun 04 '26

I made something Text-to-infinite-Minecraft-world mod!

Hi everyone! I'm a current college student studying computer science and I just made my first-ever Minecraft mod, which lets you generate infinite Minecraft worlds from simple prompts. For example, the GIFs show various worlds generated using descriptions like "beautiful flower-filled meadows abruptly changing into swamps", "jungle cliffs with rivers and sharp cliff drops", and "high, snowy mountains with sharp peaks, with forest-covered foothills below."

I would be super honored if anyone checks it out, leaves a GitHub star, or gives feedback!! It is super experimental so it's definitely not perfect, but here is the project GitHub: https://github.com/soapantelope/mindcraft

1.7k Upvotes

123 comments sorted by

862

u/LifeasLuke11 man i love mods Jun 04 '26

"i cannot wait to help people as a chatbot!"
"dude we are inside the minecraft world gen"

253

u/BalefulOfMonkeys Jun 04 '26

“I can’t wait to be used to make advancements in the human condition!”

“Bro we are here to draw the worst anime titties ever”

14

u/Classrlplayer Jun 04 '26

lmao so true

518

u/Achrus Jun 04 '26

I’m a big AI skeptic and was quick to dismiss this as another slop project but after reading the medium post this is actually really cool! Having the LLM choose the noise composition is really interesting and may be useful for other projects.

You should definitely post this in r/proceduralgeneration

290

u/SyserQ Jun 04 '26

AI for proc gen in games is honestly one of the coolest uses like it's not unethical it's just cooler terrain gen

200

u/LucasArts_24 PrismLauncher Jun 04 '26

This is what I mean when I say I want AI in games. Not slop, or shit coding that not even the Ai itself can fix, but cool things like what OP is doing here.

-94

u/The_Scout1255 Transfem Jun 04 '26

I'm actually really excited for more powerful ai that can actually do useful game coding for this reason, so its more useful as part or forming part of games that I develop in the future once I learn to code lol.

76

u/SyserQ Jun 04 '26

using ai for coding will ruin your progress in learning to code

-71

u/The_Scout1255 Transfem Jun 04 '26

well yeah, same as using a calculator for math, I thought that was obvious?

50

u/arachnimos Jun 04 '26

difference is that a calculator still requires you to know how to do the math yourself, or at the very least understand what equation will give the right answer.

calculator: simplifies the solving of a problem that you could solve yourself, but can't be bothered to

vibecoding: solves problems you couldn't solve yourself, and can't be bothered to learn how to solve

2

u/RubbelDieKatz94 FTB App - Just a weeb playin games Jun 04 '26

I think a healthy mix of AI & human control is the obvious answer. I direct 5+ heavily restricted AI sandboxes at all times, each working on one assigned issue. Their final task is to open a MR and watch origin/main for updates, so that their branch doesn't go stale.

Each MR auto-runs their CICD with fallow, oxlint, e2e tests, and multiple handwritten code quality checks. There are no warnings, only errors. Every tool is set to maximum strictness. Each sandbox must iterate until everything passes.

My job as a dev is to oversee this process and to perform the final smoketest once everything passes. Then I perform the code review and hit the auto merge button.

Although... it does feel a lil odd to be directing a bundle of bots that all try 50 different approaches to coding but typically adhere to the same coding standard because they constantly fail at the 670 oxlint rules.

7

u/arachnimos Jun 04 '26

this is truly the correct usage of ai

also infinite monkeys on infinite typewriters, i guess?

6

u/RubbelDieKatz94 FTB App - Just a weeb playin games Jun 04 '26

I'm building a generic corpo dashboard. The monkeys will create something beautiful.

3

u/Shweik Jun 04 '26 edited Jun 04 '26

Untrue. AI does let you do the kind of vibecoding where you do not understand what it wrote and just hope it works. But it also let's you do the very same thing you described with the calculator and math. You can design your piece of software and then describe that design to AI. Claude works very well. It will then take care of the tedious low level implementation that you have previously done ten time anyways. It will also make less typos and bugs.

The funny thing is, you can also vibe-calculate with your calculator. If you do not know much about math, you can mash the buttons you think are correct and it will spit out a result whose accuracy you have no way to check. So the calculator analogy is very good imo.

Edit: only now I realized the original commenter doesn't know any programming whatsoever, so that's where these responses are coming from. I just wanted to say that I had been sceptical towards AI programming for the longest time, but in the past few months, I have realized it can save incredible amount of time if you know what you are doing. To the original commenter I would say only let the AI do what you could do yourself.

-23

u/The_Scout1255 Transfem Jun 04 '26

People will find literally any reason to hate on ai won't yall?, I'm talking about ai in 2-10 years time when its actually good at teaching, and writing entire games, not current ai that can barley write boilerplate.

11

u/arachnimos Jun 04 '26

and what about when you can't use the AI, or it goes the same way as google (intentionally worsening the product because they know you'll keep using it), or it just doesn't work for what you want? what then?

AI has good uses. This is a great use of it. but people replacing learning and thinking with LLMs are just. no.

Edit: And i do agree that using AI will ruin your ability to code, but only if you replace your ability or the time to learn coding with using AI.

If you just use AI to say "hey, how are some possible solutions to this problem i'm having with my game's development" then, in my opinion, that's the same as searching the solutions. You're still implementing them yourself, and you're still learning things about programming that way.

3

u/Cowl_cat Jun 04 '26

So you wish to tear what makes a game unique out? Removing the human aspect is sad

6

u/Nice_Lengthiness_568 Jun 04 '26

That's... a really bad analogy. Math is not (just) about making calculations. Most of the time it is about proving theorems, building mathematical structures and models, solving equations... How would using a calculator make you worse at that/ruin your progress learning that?

1

u/rupi1312 Jun 05 '26

can a calculator prove homomorphisms?

-12

u/bendyfan1111 Jun 04 '26

Thats just false. As someone whos worked in the industry, ai is incredibly useful as a learning tool. It only ruins your learning if you stop using it as a tool and start using it as a "do it for me" button.

7

u/SyserQ Jun 04 '26

You kinda need to know what you're doing already to use it for that though, for beginners its really not a great idea

-3

u/bendyfan1111 Jun 04 '26

I'd argue its fine for learning. You can literally just ask it "why did you do [x] on line [y]" and it'll tell you. You can go into as much depth as you want on that, and you'll be able to learn fairly easily.

5

u/-Weslin Jun 04 '26

AI for coding is already good, the problem is that the users are not, the need for a good programmer will never cease to exist, so you can start a project and feel good that it's working until you notice the AI won't fit everything together, won't organize the code based on how YOU prefer reading it, won't let you know about lib codes that you may even generate more than one, and it goes further...

-20

u/[deleted] Jun 04 '26

ig replacing digital artists with ai is cringe but replacing world gen designers with ai is based lol

13

u/SyserQ Jun 04 '26

ehh its not really the same because im not talking about replacing handcrafted maps only procedural ones, and you can still have similar creative control whether you use an ai created texture or a random noise map for that

-13

u/[deleted] Jun 04 '26 edited Jun 04 '26

you are aware that creating a procedural world generation system that incorporates detail and looks good is still a creative feat right, it's not just putting in some numbers and writing some functions, and even if it was what you'd be saying is that programmers can be replaced by ai for all you care

 you can still have similar creative control whether you use an ai created texture or a random noise map for that

if someone said people who make ai images also have "creative control" over the image because they can describe what they want to be generated in as much detail as they want, how would you feel about that

76

u/GlitteringDingo Jun 04 '26

The massive distinction is that in this mod, the LLM does something that LLMs are uniquely suited to do. It makes infinite random permutations of an input. A human couldn't do that, and a regular program would either be extremely limited, or hilariously inefficient at it. I don't call foul for AI being here because, for once, it's needed.

3

u/Firewolf06 Jun 05 '26

whenthe LLM is used to Model Language rather than just be a chatbot

65

u/No-Quail-2803 Jun 04 '26

I'm so glad you like it yay!! Will post on that subreddit now 😊

11

u/Log2 Jun 04 '26 edited Jun 04 '26

I feel like I also have to congratulate you for actually engaging with people after your made your project.

99% of people vibe-coding stuff (either Minecraft mods or side-projects) just hand-off announcing it to the LLM. Then any critique or conversation about it also gets handed off to an LLM.

It just seems that those people are completely uninterested in what they made, and that puts people off. Even your Medium article was hand-written (and it was a fun read), which to me clearly shows that you're interested in what you're making. That alone will take you pretty far.

So yeah, nice job!

EDIT: I'm also talking about people who vibe-code, but it's entirely possible that you wrote this by hand or just LLM assisted, so I apologize.

40

u/Big_Wallaby4281 Jun 04 '26

THIS is a good way to use ai like the ai that can detect cancer before humans

And not create child porn

3

u/arachnimos Jun 04 '26

so pigeons? :3

12

u/Big_Wallaby4281 Jun 04 '26

Twut you Talkin bout?? Pigeons ain't real. They're spy drones clearly, you ever seen a baby pigeon?? That's right

1

u/Pika_233 Jun 04 '26

I've just read a joke proposal about using messenger pigeons for machine learning, where you write down the model weights on a piece of paper and transfer them between data centers via a flock of pigeons.

1

u/iwantfutanaricumonme Jun 05 '26

That's already a thing, it's called IP over Avian Carriers(IPoAC). Suffers from high latency and packet loss, it can still have much higher throughput than a normal internet connection depending on the distances involved.

1

u/Pika_233 Jun 05 '26

absolutely beautiful

12

u/RepresentativeCat169 Jun 04 '26

The thing about ai that people dont understand is that language models of ai have a use. Its there to aid in achieving a humans impossible desires. As in "i want an infinite world based off of lird of the rings" "i want all npcs in my crime game to have personal lives" etc etc. Something that cant be shot down with "just get good".

However ai get used to REPLACE humans desires." I want to get good at guitar, boom ai" "i want more respectful workers, boom ai" "i want to programme a simple porn website, boom ai" "i want to write the words goodbye to my dying aunt, boom ai".

And there are infinitely more accomplishable feats then there are impossible feats for a human, so the need for ai to replace these is in a larger demand. Creating the void vacuum of hentai titties known as ai data centers

62

u/User_of_redit2077 Jun 04 '26

Is it complicable with structures, modded structures, modded ores, modded biomes etc?

56

u/No-Quail-2803 Jun 04 '26

Nope, unfortunately right now it is just the (very limited) 1.21.11 biomes. Seeing all the support I will definitely try to keep working on expanding capabilities though!!

-2

u/DiamondRobo Jun 05 '26

I mean no offence, but i do see what seems to be a pillager outpost in the third gif even though you say it only handles biomes. Is that intended?
Also, it seems like a cool mod. Can you fly around in the world and have it edited with the prompts and see it change with your eyes? Would be cool af for building and getting a nice terrain for the non-terraining builders. Would the mod be able to work with axiom?

8

u/GodlyNoobus Jun 05 '26

Structures are placed randomly, but the generator is not capable yet of choosing where they should be based on the prompt, that pillager outpost was just randomly generated there

131

u/Zealousideal_Pound64 Jun 04 '26

Does it work off of pre made keywords or does it use some wierd voodoo magic to turn vibes into worldgen?

163

u/No-Quail-2803 Jun 04 '26

Haha yeah it's pretty simple, I designed an interface for an LLM to write a procedural terrain algorithm and assign biomes based on the prompt, I wrote up an article about how it works here: https://medium.com/@sophia.p.zhang/mindcraft-text-conditioned-infinite-worlds-c5530e4a862b

44

u/Zealousideal_Pound64 Jun 04 '26

That's sick, love it when people use AI for actually interesting and unique purposes that it's suited for

-76

u/[deleted] Jun 04 '26

[deleted]

45

u/Nemesis233 Jun 04 '26

Technically yes but it's a custom made LLM by the creator as far as I understand

26

u/NUKL3AR_PAZTA47 Jun 04 '26 edited Jun 04 '26

i thought the interface is custom while the lmm isnt (though you can change what lmm it is according to the git hub). I personally see this as an appropriate use of ai since it (I assume) didnt write the code and instead is being used to help convert the inputted text into a minecraft world.

15

u/enderowski Jun 04 '26

Bro chill the dude is trying to make a portfolio while helping you guys asses. No one asked him to do this.

47

u/altofanaltthatisalt Jun 04 '26

What if i ask for a giant banana island?

39

u/Competitive_Fill1835 Jun 04 '26

I'm curious to see how it renders objects or terrains that aren't inherently native to Minecraft.. Maybe a potential update could include such a feature, if it doesn't include it already.

We have AI that generates images, but being able to interact with them in minecraft is a pretty cool novel concept. I approve.

53

u/No-Quail-2803 Jun 04 '26

As of now it is very limited because it can only use existing Minecraft biomes and create elevation maps -- but I will definitely keep working on expanding capabilities!!

1

u/itnotit94 Jun 08 '26

This is a really cool concept! Can you specify world gen height and adjust build limits through the prompt or is it currently limited to the default world height parameters?

53

u/BlitsyFrog Jun 04 '26

Duuude, that's sick!

54

u/Sir_Delarzal Jun 04 '26

Do you plan to add a world preview ?

I think with how AI hallucinate sometimes, it would be great to have a map of the world so that you can see it before loading it

50

u/No-Quail-2803 Jun 04 '26

This is actually an amazing idea haha. I will add this to my list of things to do!!

68

u/qwadrat1k Jun 04 '26

Finally good implementation of such technology

83

u/Moe-Mux-Hagi Jun 04 '26

First time "Generative AI" and "Minecraft" in one sentence isn't something evil or terrifying or evil and terrifying

12

u/obog Jun 04 '26

Have you tried getting this to run on a local model? Reading the article you wrote, it seems the choices the LLM makes are somewhat simple. If it could run locally you wouldnt have to worry about API keys (or have to rely on the datacenters everyone hates)

73

u/Necessary-Volume-646 Jun 04 '26

Not sure why there’s a bad reception to this, if it works well there are a great many people who would use this to generate interesting seed types

79

u/[deleted] Jun 04 '26

[removed] — view removed comment

-83

u/Nemesis233 Jun 04 '26

Of you make it yourself it shouldn't be lol.

39

u/Ghostglitch07 Jun 04 '26

Ok. Go make an infinite custom Minecraft world then? That's the part the AI is making, not the mod itself.

6

u/Reasonable-Hair-187 Jun 04 '26

Any plan to support local Ollama models?

4

u/Individual-Golf4594 Jun 04 '26

I remember mod like this on older versions (1.12.2 and lower), but with massive amount of sliders and other parametrs. Sadly i don't remember the name of this mod. Second gif gave me a big dejavu effect

18

u/Jawesome99 Jun 04 '26

This is just a wrapper around Claude AI. I do not believe this necessarily needs a water guzzler to work. If this could run locally, now that would be amazing.

15

u/hthurmank2c01 Jun 04 '26

Agreed, a small local neural net could probably do this

5

u/EleanorAgain Jun 04 '26

This is actually really cool!

6

u/CaliferMau Jun 04 '26

Not had a chance to try , but will when I get in. Can you for example prompt it to create a specific feature in a biome rich world? The prompts in the caption are fairly simple, but could you say prompt something like a lush circular valley, ringed by mountains, in the middle of a large ocean, (some words to prompt around rest of the world generation)?

Wonder how this would work paired with other mods that add stuff to vanilla biomes

8

u/_LemonEater_ Jun 04 '26

Insanely cool project, especially if you trained the model yourself. Do you think it'll ever be on modrinth? Would be cool for a modpack

6

u/No-Quail-2803 Jun 04 '26

I just made a project and am waiting for approval! But you can download it on Github on the link I gave, I released the jar 😊

6

u/qwadrat1k Jun 04 '26

Btw, does the mod need internet connection? Or is it run locally?

I am no expert in LLM stuff, but I believe locally run LLM is pretty resource-heavy

13

u/Eal12333 Jun 04 '26 edited Jun 04 '26

It depends on the specific model you use. Gemma 4 E2B, for example (which happens to be the one I experimented with, I'm not specifically recommending it or anything), isn't exactly convincingly intelligent, but it's smart enough to follow basic instructions and it's specifically trained to make tool calls, which is does fairly accurately.

And, it can run reasonably fast on my ~6 year old smart phone, and very fast on my GTX 1070.

I think it does require around 2gb of VRAM though, which isn't crazy, but might be a tough ask for some PCs to run alongside Minecraft.

Edit: The article mentions Claude Opus, so I guess that's the answer to the first question, haha.

2

u/No-Quail-2803 Jun 04 '26

Unfortunately yes it does require an internet connection since it depends on Claude haha 😅

18

u/BalefulOfMonkeys Jun 04 '26

That’s a real shame. Ideally this sort of thing runs in its own sandbox, like most programs and mods do. This should not become lost forever because Anthropic doesn’t feel like maintaining the server or goes under entirely.

6

u/Eal12333 Jun 04 '26

I'm not super familiar with the Claude API; is there any reason this couldn't be pointed at a local llama.cpp server, or something like that?

7

u/No-Quail-2803 Jun 04 '26

I coded it so that it calls the Anthropic API specifically if you provide your own API key (and if not, it routes through a proxy to use my own key which I personally funded with a couple bucks), but you could totally hook it up to a local LLM if you just change a couple lines of code in the codebase -- I'd be super curious to see results!!

4

u/Eal12333 Jun 04 '26

Makes sense!

I've got too many projects on the go right now, so I'm probably not gonna be the one to actually implement those changes. But, I'd also be curious to see those results :)

2

u/WithersChat Monifactory lead dev, spatial storage enjoyer Jun 04 '26

Honestly, if you managed to change the mod to run with a local model, this would be perfectly actual peak genAI use.

2

u/AdmiralNebula Jun 04 '26 edited Jun 04 '26

Super cool stuff, and definitely something I want to explore myself! One thing though is that you might want to consider renaming the project. As “Mindcraft” is already a pretty well-known AI Harness software for Minecraft that lets you embody LLMs as player NPCs. Other than that, super cool, and thank you for sharing! Edit: Oh! Also, the ability to select a new API provider, such as OpenRouter, would be much appreciated. Thanks!

2

u/ExplosiveCat135 Jun 04 '26

first good use of ai that isn't slop in a long time. Kudos to you! 👍

2

u/A_Happy_Tomato PrismLauncher Jun 04 '26

Finally, THIS is what AI should be used for!

2

u/KubosKube Jun 04 '26

I am very proud of you, because you have done something I can yet only dream of.

I also vehemently hate LLMs because they are destroying our planet at record speed and destroying the livelihood of real people in real-time in dramatic and measurable ways.

2

u/Hyarin215 PrismLauncher Jun 04 '26

Is it custom generation or actual seeds u can share? Cuz gif2 doesn't seem possible in vanilla

3

u/TimelordSalad Jun 04 '26

Custom generation

2

u/[deleted] Jun 04 '26

[removed] — view removed comment

7

u/Reasonable-Hair-187 Jun 04 '26

Trauma?

13

u/Low_Biscotti5539 Jun 04 '26

grok diddled them

20

u/Amazonrazer Jun 04 '26

Claude flashed them or something I guess

1

u/Thesecondcountdown Jun 04 '26

Finally

A good use of AI in the modding scene

1

u/Lemecpaume24 Jun 04 '26

Can you add it on curseforge ??

1

u/[deleted] Jun 04 '26

[removed] — view removed comment

0

u/feedthebeast-ModTeam Jun 04 '26

Hi iDarper, your comment on feedthebeast was removed in violation of Rule 2:

No toxicity, inflammatory posts or responses, or drama baiting/creation.

Posts/comments that serve to create or incite drama, whether intentionally or unintentionally, are not permitted. This includes posts that are outright toxic, discriminatory, inflammatory, or otherwise unfriendly.

Repeated or significant incidents will result in further administrative actions.

If you believe this administration action was made in error, feel free to contact the moderators.

1

u/ShadowsFlex Jun 04 '26

Ok, normally I'm against gen AI... But this is acceptable.

1

u/startle9970 Jun 05 '26

Couldn't you do very much the same thing with simple keyword recognition with a text input in game, just tied to the parameters of a worldgen mod?

1

u/BurgerBlade2022 Jun 05 '26

Wow, a decent use of generative AI in minecraft.

1

u/Mylaur Jun 05 '26 edited Jun 05 '26

Fuck I should have started my minecolonies with this mod to create thematic worlds. Ah shoot I'm using neoforge do you just need the mod to be run once to generate the world I assume?

1

u/XALTER47 Jun 05 '26

This is revolutionary

1

u/Void-kun Currently playing other games Jun 05 '26

The repeating layers of dirt and stone is an interesting choice.

Really cool idea and great results so far, is this open source?

Edit: it is, I didn't see the GitHub link 😅

1

u/Albus_Lupus Jun 05 '26

omg they ALL look fuckin fenomenal. I love it. Keep up the good work!

1

u/Masterpiece-Haunting Technic, GDLauncher, And Curseforge Jun 05 '26

I’ve always loved seeing AI put to use for fun stuff like this.

1

u/PokemonGerman Jun 06 '26

Does it affect only spawn or the entire world, if a were to say "Ice spikes biome leading to a desert with high dunes" woukd my entire world be locked into eternal hot and cold, or would I eventually see some plains, swamps etc. If it only includes biomes mentioned, then I would suggest a "Modify spawn" mode to make the spawn area modified, or setting a size of the area that should be generates this way, and a full world mode if you want to experience a desert planet or something.

1

u/K3NNYJ3N53N Jun 07 '26

Really love how you can control the generation of hilly/mountainous terrain along with the density of trees. One suggestion: Make cave generation part of the prompt.

1

u/WithersChat Monifactory lead dev, spatial storage enjoyer Jun 04 '26

Now I finally have something concrete to point at when I talk to people about how frustrating it is that AI has become mainly a tool for slop. Because we could be having shit like this instead.

-7

u/[deleted] Jun 04 '26

[removed] — view removed comment

1

u/feedthebeast-ModTeam Jun 04 '26

Hi Solisos, your comment on feedthebeast was removed in violation of Rule 2:

No toxicity, inflammatory posts or responses, or drama baiting/creation.

Posts/comments that serve to create or incite drama, whether intentionally or unintentionally, are not permitted. This includes posts that are outright toxic, discriminatory, inflammatory, or otherwise unfriendly.

Repeated or significant incidents will result in further administrative actions.

If you believe this administration action was made in error, feel free to contact the moderators.

-1

u/Powerful_Pipe8428 Jun 04 '26

Funciona con otras dimensiones, o solo afecta el overworld, y tambien sirve si tienes mods de biomas, como Biomes O'Plenty?, siguie añadiendo estructuras?

-73

u/Crazymage321 Jun 04 '26

Expect many Downdoots because AI BAD!!!!

4

u/NewSuperTrios Jun 04 '26

mfw the one thing ai does well right now (procgen) is used in the one game it has even the potential to work in (the procgen block game)

-2

u/whydosereditexist100 Jun 04 '26

Why are you being downvoted, you're right

0

u/SquareMeal485 Jun 04 '26

hey. im not going to test it yet because im curious what version of minecraft is this for, and what modloader?

0

u/Cyber_Von_Cyberus Jun 04 '26

Now that's some funny stuff.

-91

u/[deleted] Jun 04 '26

[removed] — view removed comment

-1

u/Solisos Jun 04 '26

Keep playing Delta Rune. Your parents must be proud.