The hard bit of software engineering has always been “deeply understanding a problem well enough to implement a useful solution to it”.
The scary bit of people trying to AI away the programming part is that most rely on writing the software to understand the problem domain — remove that part and you truly do have YOLO driven development with badly thought out questions “generating” bad and kinda broken software.