Definitely starting to hear of more places rolling their own systems like this and having success. The feedback loop between the agent and the environment matters so much that commercial software likely won’t work in this space for a while, as the article points out:

Current frontier models are very capable at a wide range of software engineering tasks, but they cannot synthesize a large codebase with a large observability surface and determine what needs attention. Prioritization at production scale requires a level of intelligence surpassing that of any model available today.

That will change fast I’m sure, but in the interim there is likely value in experimenting with these patterns.