Tag: redis
Beyond keys: The rise of semantic and prefix caching for LLMs
An exploration of how new caching techniques from Redis, OpenAI, and Claude are tackling the expensive problem of repetitive LLM calls.
More tags:
- adoption
- agents
- ai
- amazon
- analogy
- architecture
- autonomy
- best-practices
- books
- build vs buy
- business
- business intelligence
- business strategy
- caching
- career
- career-development
- chatgpt
- communication
- concepts
- continuous-discovery
- coursera
- coverage
- cursor
- data
- data-science
- databricks
- decision-making
- design
- design-principles
- developer productivity
- development
- devops
- dictation
- disruption
- documentation
- domain engineering
- efficiency
- energy
- engineering
- engineering-leadership
- europe
- exhibition
- focus
- framework
- future-of-work
- game
- genbi
- github
- habits
- innovation
- inspiration
- intuition
- kilocode
- leadership
- learning
- links
- llm
- llms
- machine-learning
- management
- martin-fowler
- metrics
- michael pilarczyk
- military
- mindset
- mlops
- morale
- nasa
- networking
- nlp
- pace-layering
- personal
- platform-engineering
- podcast
- policies
- product management
- productivity
- programming
- proprietary data
- python
- redis
- remote work
- renewables
- resources
- roger martin
- security
- simon-willison
- society
- software engineering
- software-architecture
- software-development
- strategy
- substack
- summary
- survey
- system-design
- systems engineering
- systems-engineering
- systems-thinking
- team building
- teams
- tech-leadership
- technology
- technology-assessment
- testing
- thoughtworks
- tools
- tutorials
- vibe-coding
- wardley-maps
- workflow