Eden T&S (CEO Kim Yeon-gi) has emerged as a frontrunner within the Korean Large Language Model (LLM) rating.
Eden T&S's model 'DataVortexS-10.7B-dpo-v1.0' ranked 2nd within the 2nd week of February within the 'Open Ko-LLM Leaderboard' co-hosted by Upstage and the Korea Intelligence and Information Society Agency (NIA). did.
Above all, it scored 56.91 points and 65.81 points in 'reasoning ability (ARC)' and 'common sense ability (HellaSwag)', respectively. That is currently the best rating in each field throughout the top 10.
EdenTE&S is an organization specializing in RPA (robotic process automation) solutions. He explained that he’s currently moving toward specializing in data collection, management, and utilization.
They introduced that through participation within the leaderboard, they’re creating optimal inference techniques by applying their very own data sets based on various bases. This model used 'Mega Study/M-SOLAR-10.7B-v1.3', which is predicated on Upstage's 'Solar', as the bottom.
Particularly, he emphasized, “We’re showing strength in constructing datasets with the expertise we have now gained from directly handling data through RPA.”
Established in 2007, Eden T&S developed Korea's first web-based RPA solution, 'Worktronics' RPA, in 2021 and has provided services to greater than 120 corporations in various fields, including public enterprises, manufacturing, and distribution.
Recently, it was revealed that requests for generative artificial intelligence (AI) services have been received from various fields. Subsequently, he said that he’s currently within the stage of internalizing and commercializing generative AI technology in 'Worktronics_RPA' and 'DataVortex_Platform'.
On this process, rating second on the leaderboard was explained as evidence of successful technological advancement. The event of this model was handled by Director Seung-hyeon Choi, Researcher Hyo-seok Choi, and AI developers Gwang-seok Yang and Jeong-won Choi of the Future Strategy and Technology Department.
An official from Eden T&S said, “We’re really joyful,” and added, “The leaderboard may not represent all of our AI technology, but we’re proud that we have now risen to the highest by competing with distinguished listed corporations.”
Meanwhile, Lotte Data Communication has been maintaining normalcy for a month because the third week of January. As well as, strong players which have emerged prior to now couple of months, corresponding to Inswave, CJ OliveNetworks, Megastudy, and Yanolja, are forming the highest ranks.
Amongst them, the primary place Lotte Data Communication model 'LDCC-SOLAR-10.7B' is recording a mean rating of 59.34 points. Beyond this, interest is in when a model with a mean rating of over 60 points will appear for the primary time within the Korean benchmark.
Leaderboard details NIA homepageme Hugging Face HomepageYou possibly can check it here.
Reporter Jang Se-min semim99@aitimes.com
