Structured outputs with small local models
Using structured generation to make small VLM reliable at OCR
Peeks are simple posts about my current interests.
Is coding over?
With the stunning progresses of AI assisted coding, is software engineering doomed to be automated?
LLM inference engines and servers
Deploying a LLM on your own infrastructure is getting common, but how does it actually work?