• About
  • Subscribe
  • Contact
Wednesday, May 7, 2025
    Login
  • Management Leadership
    • Growth Strategies
    • Finance
    • Operations
    • Sales and Marketing
    • Careers
  • Technology
    • Infrastructure and Platforms
    • Business Applications and Databases
    • Big Data, Analytics and Intelligence
    • Security
  • Industry Verticals
    • Finance and Insurance
    • Manufacturing
    • Logistics and Transportation
    • Retail and Wholesale
    • Hospitality and Tourism
    • Government and Public Services
    • Utilities
    • Media and Telecommunications
  • Resources
    • Whitepapers
    • PodChats
    • Videos
  • Events
No Result
View All Result
  • Management Leadership
    • Growth Strategies
    • Finance
    • Operations
    • Sales and Marketing
    • Careers
  • Technology
    • Infrastructure and Platforms
    • Business Applications and Databases
    • Big Data, Analytics and Intelligence
    • Security
  • Industry Verticals
    • Finance and Insurance
    • Manufacturing
    • Logistics and Transportation
    • Retail and Wholesale
    • Hospitality and Tourism
    • Government and Public Services
    • Utilities
    • Media and Telecommunications
  • Resources
    • Whitepapers
    • PodChats
    • Videos
  • Events
No Result
View All Result
No Result
View All Result
Home Technology

The key to unlocking the power of generative AI

Noel Yuhanna by Noel Yuhanna
October 23, 2023
Image by Colossus Cloud from Pixabay

Image by Colossus Cloud from Pixabay

In the age of generative AI (genAI), vector databases are becoming increasingly important. They provide a critical capability for storing and retrieving high-dimensional vector representations, essential for supporting large language models (LLMs). Unlike traditional databases that are optimized for exact matches, vector databases are designed to support similarity searches. Vector databases are ideal for applications where the goal is to find data points similar to a given vector. For example, a vector database can find images similar to a given image, or text similar to a given text. With vectors, LLMs can process requests quickly delivering the performance needed to run complex analyses.

Although vector databases have been around for decades, their application was limited. Forrester estimates the current adoption rate of vector databases at 6%, with a projected surge to 18% over the next 12 months. I believe the potential for vector databases is huge, especially to get insights from untapped data assets. We are already seeing organizations using vector databases to improve customer recommendations, for real-time anomaly detection with IoT data, and for fraud detection.

There Are Different Types Of Vector Databases

Besides storing vectors, vector databases offer several essential data management capabilities. These include efficient metadata storage, real-time data changes, granular access control, resource allocation for performance, concurrency management, and elastic scale. Vector databases have built-in search capability that quickly delivers optimized and relevant results, especially with complex data sets such as image, video, and audio. In addition, vector databases support pretrained embeddings of data such as word or image embeddings to provide fast access to support ML models. And its ability to store and process high-dimensional data efficiently allows it to find patterns and relationships invisible to non-vector databases.

Two types:

  • Dedicated vector databases. These databases have an advantage over traditional databases when scaling to billions of vectors. They offer optimized storage and query capabilities for vector embeddings. Many organizations are using these databases for genAI, and we are hearing very positive feedback on their usage.
  • Extended vector databases. These databases don’t support vectors natively but through vector indexes and functions. We believe that most traditional databases will offer some level of vector processing capabilities in the near future. Some traditional database vendors already support vector data, offering broader multimodel capabilities. Organizations are using them to integrate traditional structured and unstructured data with high-dimensional vectors to support semantically driven LLMs.

Originally posted on Forrester

Related:  AFFINBANK modernises multi-channel customer engagement
Tags: Artificial IntelligenceForrestergenerative AIlarge language model (LLM)vector database
Noel Yuhanna

Noel Yuhanna

Noel Yuhanna, VP and principal analyst with Forrester, covers big data, data warehouses, data fabric, data integration, data virtualisation, Hadoop, Spark, in-memory, translytical, NoSQL, cloud, ETL, big data integration, data management, data tools, and data security for enterprise architecture professionals. His current focus is on new and emerging markets, modern data architectures, cloud and hybrid cloud deployments. Previous Work Experience Yuhanna has more than 25 years of experience in IT and has held various technical and management positions. He came to Forrester through its acquisition of Giga Information Group in 2003. Prior to joining Giga, Yuhanna spent several years at Exodus Communications and led a group responsible for planning and implementing mission-critical enterprise applications including ERP, CRM, and other internal apps. Prior to Exodus, he served as a principal consultant, benchmark specialist, and data architect for Amdahl Corporation. He worked on several very large database applications and deployed high-availability and high-scalability solutions for Fortune 100 companies. He was responsible for running the world’s fastest TPC-B benchmark on Informix at Amdahl in 1994 and built the first commercial terabyte-sized database on Oracle in the early 1990s. He worked on nCube MPP Database in the early '90s and helped enterprises scale their mission-critical applications. At his first job at Eicher Goodearth Corporation in the mid-1980s, he started working with COBOL programs and later expanded his knowledge toward data modeling, programming, and administration using RDBMS technologies. Yuhanna has spoken at numerous industry conferences around the globe and is quoted frequently in industry publications such as CNET News, Computerworld, eWeek, InfoWorld, InformationWeek, Forbes, Search.com, The Wall Street Journal, and The New York Times. He has taught several technical and management workshops on big data, data management, data integration, building scalable apps, in-memory platforms, and data virtualisation. Education Yuhanna holds a bachelor's degree in business and a postgraduate degree in business administration. He is the author of an Oracle book published by Manning Publications in 1999.

No Result
View All Result

Recent Posts

  • Agentic AI-powered AppSec platform launched for the AI era
  • IDC forecasts GenAI alone will grow at a 59.2% CAGR
  • Dataiku brings new AI capabilities to create and control AI agents
  • Microsoft reveals the rise of a new kind of organisation in the AI era
  • St Luke’s ElderCare enhances data security and user experience with Juniper

Live Poll

Categories

  • Big Data, Analytics & Intelligence
  • Business Applications & Databases
  • Business-IT Alignment
  • Careers
  • Case Studies
  • CISO
  • CISO strategies
  • Cloud, Virtualization, Operating Environments and Middleware
  • Computer, Storage, Networks, Connectivity
  • Corporate Social Responsibility
  • Customer Experience / Engagement
  • Cyber risk management
  • Cyberattacks and data breaches
  • Cybersecurity careers
  • Cybersecurity operations
  • Education
  • Education
  • Finance
  • Finance & Insurance
  • FutureCISO
  • General
  • Governance, Risk and Compliance
  • Government and Public Services
  • Growth Strategies
  • Hospitality & Tourism
  • HR, education and Training
  • Industry Verticals
  • Infrastructure & Platforms
  • Insider threats
  • Latest Stories
  • Logistics & Transportation
  • Management Leadership
  • Manufacturing
  • Media and Telecommunications
  • News Stories
  • Operations
  • Opinion
  • Opinions
  • People
  • Process
  • Remote work
  • Retail & Wholesale
  • Sales & Marketing
  • Security
  • Tactics and Strategies
  • Technology
  • Utilities
  • Videos
  • Vulnerabilities and threats
  • White Papers

Strategic Insights for Chief Information Officers

FutureCIO is about enabling the CIO, his team, the leadership and the enterprise through shared expertise, know-how and experience - through a community of shared interests and goals. It is also about discovering unknown best practices that will help realize new business models.

Quick Links

  • Videos
  • Resources
  • Subscribe
  • Contact

Cxociety Media Brands

  • FutureIoT
  • FutureCFO
  • FutureCIO

Categories

  • Privacy Policy
  • Terms of Use
  • Cookie Policy

Copyright © 2022 Cxociety Pte Ltd | Designed by Pixl

Login to your account below

or

Not a member yet? Register here

Forgotten Password?

Fill the forms bellow to register

All fields are required. Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Management Leadership
    • Growth Strategies
    • Finance
    • Operations
    • Sales and Marketing
    • Careers
  • Technology
    • Infrastructure and Platforms
    • Business Applications and Databases
    • Big Data, Analytics and Intelligence
    • Security
  • Industry Verticals
    • Finance and Insurance
    • Manufacturing
    • Logistics and Transportation
    • Retail and Wholesale
    • Hospitality and Tourism
    • Government and Public Services
    • Utilities
    • Media and Telecommunications
  • Resources
    • Whitepapers
    • PodChats
    • Videos
  • Events
Login

Copyright © 2022 Cxociety Pte Ltd | Designed by Pixl

Subscribe