FRONTEO succeeds in improving an AI algorithm that captures the subtleties of human behavior

Home » corporate » News » 2022 » FRONTEO succeeds in improving an AI algorithm that captures the subtleties of human behavior
2022.08.24 Press release

--To the press -

FRONTEO succeeds in improving an AI algorithm that captures the subtleties of human behavior

Up to 80% reduction in the number of review documents required to find 44% of relevant documents in digital forensics

FRONTEO Inc.
Masahiro Morimoto, President and CEO
2-12-23 Konan, Minato-ku, Tokyo
(Code number: 2158 TSE Growth)

 FRONTEO Co., Ltd. (Headquarters: Minato-ku, Tokyo, President: Masahiro Morimoto, hereinafter FRONTEO) is one of the core technologies that make up the AI ​​engine "KIBIT" developed in-house.1, classification performance that reduces the number of evidence-related documents and unrelated review documents in digital forensics (information security and analysis investigations targeting information recorded on digital devices) by up to 44% compared to the past by improving the algorithm. has been successfully improved.

 

 The amount of data managed by companies is increasing year by year, and digital forensics collects several TB of data per evidence holder (custodian) and extracts limited data from a huge amount of documents. Documents related to evidence must be found within the specified period.For attorneys involved in investigations, time, cost and investigation quality are major challenges.Among them, document review in the process of discovering relevant information is said to account for about 1% of the time and cost, making the use of AI essential. KIBIT is already being used in the legal tech field in the United States and Japan, and has helped solve problems by significantly reducing the amount of documents related to reviews and the associated time and costs.

 

 In Landscapescaping, which is one of the core technologies that make up KIBIT, this improvement is for words that are highly likely to indicate the subtleties of human behavior, among the highly rare words that do not appear frequently in the data. We have developed a unique technology that formulates the degree of relevance to documentary evidence in a more precise manner based on statistics.For example, inverse document frequency (IDF)* is commonly used for rare words2In addition to this, we used a method that considers statistical errors caused by the number of occurrences of words and a method that calculates the degree of relevance of evidence from the obtained rarity.The result is up to a 80% reduction in the number of human-reviewed documents required to find 44% of the evidence-relevant documents, and an improved recall rate*3 improved. (See Figure XNUMX, using FRONTEO test data) 

 

 As a pioneer of digital forensics and discovery in Japan (discovery procedures in the US civil litigation system), FRONTEO will continue to develop and improve AI technology that will help improve the efficiency of fraud investigations and litigation support.

 

Figure XNUMX. Comparison before (orange) and after (green) improvement.
Compared to the review without AI (random sampling, black dotted line),
It showed high classification performance even before the improvement, but after the improvement, further improvement in classification performance has been achieved.

 

*1 Landscaping: Based on the amount of mutual information, FROTNEO's unique core technology with excellent intuition and explainability that can quantify the degree of relevance of each word in evidence documents.It is designed for analysis of data with a low proportion of relevant documents as evidence, and we expect to apply it to more digital forensic cases in the future.
*2 Inverse document frequency (IDF): A measure of how rare a word appears in a few documents in the data.
* 3 Recall Rate: Recall rate.Percentage of all data that is relevant as evidence that is correctly predicted to be relevant.

 

 

■ About KIBIT URL: https://www.fronteo.com/products/kibit/
"KIBIT" is an artificial intelligence that analyzes text without relying on keywords, using a unique machine learning algorithm that reproduces the "tacit knowledge" possessed by specialists and business experts.Highly accurate analysis in a short time is possible with a small amount of teacher data.

 

■ About FRONTEO URL: https://www.fronteo.com/
FRONTEO is a data analysis company that uses the in-house developed AI engines KIBIT and Concept Encoder, Looca Cross specialized in natural language processing to extract meaningful and significant information from a large amount of textual data and support companies' business. Since its inception in August 2003, we have been working globally with Japan, the United States, Korea, and Taiwan, mainly in the Legaltech business, such as e-discovery (electronic evidence disclosure) and digital forensic surveys, which support company international lawsuits. Based on AI technology developed in this project, we have expanded our business fields to life science, business intelligence, and economic security since 8, and have used AI to transform textual data into knowledge, thus contributing to the resolution of various companies' issues, including support for drug discovery, support for dementia diagnostics, and support for financial, human resources, and business. Listed on TSE Mothers (currently TSE Growth) on June 2014, 2007. In January 6, the company obtained a license to manufacture and sell Class I medical devices (license number: 26B2021X1), and in September of the same year, the company submitted a notification to sell controlled medical devices (notification number: 13MinatoMiSeikikiDai1). Capital: ¥10350 (as of March 9, 3).

 

* FRONTEO, KIBIT, conceptencoder, and Looca Cross are registered trademarks of FRONTEO in Japan.

 

 

<Contact for inquiries from the press>

PR Department, FRONTEO, Inc.

Email: pr_contact@fronteo.com