Just a warning about testing with snake/tetris - they're the most reimplemented games in the world and there's so many examples those models learned from. For a more realistic test, it's better to try something novel.
Mm, even so Tetris is one of my tests, and one of the models small enough to run locally on my machine… started off badly, then suddenly switched from "Tetris as a web app" to "train an ML model in python".
So I think it's a valid quick sanity test, like fizz-buzz for human devs.
Agreed, but I think that dismisses the ease of use of this product compared to other offerings. Being able to type in a single sentence and have a full webpage of exactly what you asked for in less time than takes to stand up and stretch is kind of magical.
search engine dot com and “snake game” is still probably faster though. which is the point gp was trying to make. there’s so much training data on snake, that this is what you’re essentially doing.