About
The Korea Press Foundation (KPF) is a Korean government organization dedicated to advancing journalism and media innovation in South Korea. It supports the press industry by providing research, training, and technological solutions to address evolving challenges in the digital era. Through initiatives like BIG KINDS, its flagship news database and search platform, the Korea Press Foundation continues to pioneer efforts in leveraging technology to empower journalists and improve information dissemination nationwide.
Problem
News platforms face significant challenges when it comes to generating accurate responses to natural language queries. Traditional news search engines rely heavily on keyword-based searches, which are ineffective at handling user queries expressed in everyday language. Additionally, hallucinations in Large Language Models (LLMs) often result in erroneous or irrelevant answers, creating a barrier to providing reliable information. With a constant influx of articles published in real-time, there was a pressing need for a system that could deliver precise, up-to-date answers without compromising on accuracy.
Solution
To tackle these challenges, Upstage developed a cutting-edge Retrieval-Augmented Generation (RAG) system in collaboration with the Korea Press Foundation. This system leverages advanced AI capabilities to enhance natural language query handling, providing accurate, context-aware responses based on real-time information. By using approximately 82 million articles provided by the Korea Press Foundation, Upstage built the BIG KINDS AI service, which integrates key functionalities such as real-time data updates, natural language question-based search, and highly stable performance suitable for public institutions.
The BIG KINDS AI system utilizes a two-stage retrieval process to optimize resource use and ensure the highest quality search results. The query engine first processes user queries to discern search intent and extract core queries, followed by the search engine which generates candidate responses and ranking them for relevance. Upstage also employed comprehensive prompt engineering to optimize the system’s performance for specific use cases, ensuring it met the precise needs of the Korea Press Foundation.
Additionally, Upstage leveraged AWS resources, including EC2 for computing power and S3 for secure data storage, to build a scalable and efficient infrastructure.
Results
BIG KINDS AI achieved a quality evaluation score of 86, surpassing the benchmark of 80 points set by the client. The Korea Press Foundation also rated its satisfaction at 92.2 points, reflecting Upstage’s exceptional performance.
Key outcomes include:
- Enhanced user experience with intuitive, natural language-based search.
- Increased article search traffic, validating the effectiveness of the new system.
- Reliable and secure infrastructure capable of handling real-time data processing.
By tailoring its RAG system to meet the unique demands of public institutions, Upstage has demonstrated how advanced AI can revolutionize the news search experience, setting a new standard for accuracy, efficiency, and user satisfaction.