Articles From JakeBlog

Cloud cost optimization isn’t simply a matter of “switching to smaller servers.” It starts with understanding the actual workload, then using billing data and monitoring to identify the true sources of cost, and finally verifying through rolling deployments, health checks, and cold-start tests that the optimized system remains reliable. Background: Fixed Costs in a Production Environment This is a…

Every time a large language model generates a token, it draws on the content that came before it. If it had to compute everything from scratch at every step, responses would be much slower. When building an agent, the same set of system prompts, tool definitions, and conversation history is used over and over again. If these were reprocessed each time, latency and computational costs would continu…

If you’ve ever built a large-language-model application, you’ve most likely started with this endpoint: POST /v1/chat/completions In the era of GPT-3.5 and GPT-4, this endpoint was practically synonymous with the OpenAI API. Developers would pass in a set of messages, and the model would generate the next response based on the context. But as applications have evolved from “chatbots” to “agents ca…

I have recently embarked on a career as an entrepreneur. I imagine that many of you are thinking, “You just couldn’t resist after all!” During my college years, I often received inquiries from others regarding my decision not to establish a business. I was still relatively inexperienced at the time and was unable to provide a definitive response. On one hand, I could rapidly tran…

In 2026, generative AI (GenAI) gradually evolved and took shape as so-called “agents,” entering everyone’s lives at an astonishing pace (regardless of the specific concept, this article collectively refers to them as “AI” for the sake of simplicity). From content creation and information retrieval to daily office work, an increasing number of professionals are turning…

The capital markets’ perspective on AI has been quite interesting lately. It began to cool off in the second half of last year, shifted to skepticism about the return on investment early this year, and has recently seen a resurgence of confidence. This is a stark change, and it has been like a roller coaster ride in just a few short months. While concerns remain, the most severe issues appea…

The concept that “AI will replace software” has recently gained significant traction. This has led to a significant decline in software stocks, and when combined with concerns about the profitability of AI, has caused widespread anxiety in the market. While there are legitimate concerns about the profitability of AI, it is important to note that the cost of developing AI remains high, …