Why ROI for GenAI is Hard: Part 1 - ThetaRho Inc substack

Oct 8, 2024 · We will first consider why it is hard to measure the benefit of GenAI solutions, and in subsequent blogs talk about why it is easy to hard to know how much effort is needed to get …

CouponFollow Extension

FAQs about Why ROI for GenAI is Hard: Part 1 - ThetaRho Inc substack Coupon?

Will Genai run faster?

Nvidia, Apple, Etched, Groq, and many others are working on faster chips. In the near future, GenAI models may run so quickly that the latency drops below 200 milliseconds. This is especially imminent in the case of voice due to speech2speech models like GPT-4o and Kyutai Moshi. ...

Should you wait for Genai?

People are used to instant gratification. In most software applications, you can click a button and expect the action to take place instantly. But with many GenAI features, you have to wait because it takes time to compute the answer. Of course there are exceptions. ...

Are Genai features still a thing on X?

GenAI features are rapidly popping up in products across industries, from fintech (Ramp, Brex) to design (Adobe, Figma). Nearly every day, somebody ships a new AI feature to much fanfare on X. Yet while some GenAI features have taken off (Cursor Tab, Claude Artifacts), most have gone to the growing graveyard of flashy but forgotten novelties. ...

What happened to Genai on X?

Nearly every day, somebody ships a new AI feature to much fanfare on X. Yet while some GenAI features have taken off (Cursor Tab, Claude Artifacts), most have gone to the growing graveyard of flashy but forgotten novelties. Many products go immensely viral, driving thousands of signups. ...

How are Genai features different?

Word → Notion. Excel → Paradigm. GenAI features are different in a lot of important ways! They need special UX consideration due to their unique challenges. Their outputs are unpredictable and often need editing, users have to wait for responses, natural language inputs are frequently too vague, and chat interfaces alone can be clunky. ...

How do I get around the slowness of Genai?

Another way to get around the slowness of GenAI is to do as much as possible before the user needs it. For example, there is no “Embed codebase” button in Cursor. Cursor automatically embeds (and updates embeddings) code in the background. Similarly, Cursor Tab and Github Copilot are always calculating. ...