Tag: caching
Beyond keys: The rise of semantic and prefix caching for LLMs
An exploration of how new caching techniques from Redis, OpenAI, and Claude are tackling the expensive problem of repetitive LLM calls.
More tags:
- adoption
- agents
- ai
- ai-development
- amazon
- analogy
- architecture
- autonomy
- aws
- best-practices
- books
- build vs buy
- business
- business intelligence
- business strategy
- caching
- career
- career-development
- change management
- chatgpt
- claude
- cloud
- coding
- communication
- concepts
- continuous-discovery
- coursera
- coverage
- critical-thinking
- cursor
- data
- data centres
- data-science
- databricks
- decision-making
- design
- design-principles
- developer productivity
- development
- devops
- dictation
- disruption
- documentation
- domain engineering
- economics
- education
- efficiency
- energy
- engineering
- engineering-leadership
- ethics
- europe
- exhibition
- explainability
- focus
- framework
- future-of-work
- game
- genbi
- github
- grid stability
- habits
- innovation
- inspiration
- intuition
- investing
- kilocode
- kiss
- leadership
- learning
- links
- llm
- llms
- machine-learning
- maintenance
- management
- martin-fowler
- mbse
- mcp
- methodology
- metrics
- michael pilarczyk
- military
- mindset
- mlops
- morale
- nasa
- networking
- nlp
- organisations
- pace-layering
- personal
- platform-engineering
- podcast
- policies
- policy
- product management
- productivity
- programming
- proprietary data
- python
- rag
- redis
- reliability
- remote work
- renewables
- resources
- roger martin
- search
- security
- simon-willison
- simplicity
- society
- software design
- software development
- software engineering
- software-architecture
- software-development
- software-engineering
- startups
- strategy
- substack
- summary
- survey
- sustainability
- system design
- system-design
- systems engineering
- systems-engineering
- systems-thinking
- team building
- teams
- tech-leadership
- technology
- technology-assessment
- testing
- thoughtworks
- togaf
- tooling
- tools
- tutorials
- vc
- vibe-coding
- wardley-maps
- workflow