We tested AI coding assistants by tasking an experienced developer with building a Matrix server, a messaging client, a health app, and a blogging site - finding that each project was riddled with hidden flaws ranging from broken cryptography, insecure data handling, and misleading outputs.