
The first working prototype of the platform is hosted on the popular GitHub service, and developers from all over the world can take part in its improvement by adding verification criteria depending on the purpose of the services.
CREDIT
Center for Diagnostics and Telemedicine
Experts from the Center for Diagnostics and Telemedicine have developed a platform for self-testing services which is based on artificial intelligence and designed for medical tasks, such as for analyzing diagnostic images. The first working prototype of the platform is hosted on the popular GitHub service, and developers from all over the world can take part in its improvement by adding verification criteria depending on the purpose of the services. Sergey Morozov, CEO of the Center for Diagnostics and Telemedicine, spoke about this at the thematic week dedicated to artificial intelligence which was part of the program of the European Congress of Radiology (ECR 2020).
Before implementing a service based on artificial intelligence (AI) into routine clinical practice, it is necessary to test it for technical readiness, as well as to verify whether it meets the stated characteristics. It is called analytical validation of the algorithm. The services that have passed it are allowed to be integrated into medical systems, including city healthcare.
Integration is a complex and expensive process, so it becomes a barrier for many teams that cannot guarantee the required accuracy and speed of the algorithm processing data of the system into which they are integrated. Currently analytical validation is performed manually. Manual validation allows accidental or deliberate deviations from the approved test program, as well as manipulation of datasets, and also can potentially put different test participants in unequal conditions.
To solve these problems and automate the verification process, ensuring trust of users, specialists of the Center for Diagnostic and Telemedicine have developed a platform that allows developers of AI-based services to independently conduct preliminary tests (analytical validation) of their algorithms. A prototype of the platform has been hosted on the GitHub, and the first version of the service for exchanging datasets and data analysis results has already been uploaded.
The platform provides an opportunity for the unlimited number of accesses to single samples of data instances from the test set in order to fine-tune algorithms. It has uniform rules of use, and it is possible to test several services simultaneously. At the same time, the platform records the time that the software spends on data processing (time-study), and the developers receive an automatic report on the results of testing, – explains Sergey Morozov, CEO of the Center for Diagnostic and Telemedicine.
By automating the entire process on the self-testing platform, the human factor is minimized, which makes data manipulation (to improve results) impossible. In addition, the comparison of the service’s verification results with the reference data is absolutely transparent – the developer can see what metrics were used, and how the final result reflected in the report was calculated.
Anyone can take part in improving the platform and add necessary metrics to it, which will be used to evaluate the algorithm’s performance for certain medical purposes (for example, for analyzing radiographs or mammograms). However, the addition of the platform will be monitored – the only metrics that have scientific justification will be included in the platform operating on the basis of the Center, – notes Nikolai Pavlov, the developer of the platform, Head of Dataset Labeling Conveyor of the Medical Informatics, Radiomics and Radiogenomics Sector, Center for Diagnostics and Telemedicine.
The creators of the platform invite developers of AI algorithms, programmers and researchers to take part in updating and improving the platform in order to develop a uniform, universal, and user-friendly tool for self-testing of artificial intelligence algorithms intended for medical purposes in the international community. At the moment, there is no such tool aimed specifically at the clinical implementation of services based on AI technologies.
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
AI medical services
- Judge Uses ChatGPT in Medical Rights Case in Colombia
A Colombian judge reportedly used the AI tool to determine if a boy diagnosed with Autism was exempt from paying medical costs.
- Uncertain Economy Spurs Growth in AI-Powered Office Automation
Companies are striving to fuel growth without adding to payrolls, corporate technology chiefs say.
- We asked the new AI to do some simple rocket science. It crashed and burned
Tiera Fletcher carefully read through an artificial intelligence chatbot's attempt at rocket science. "That's true, that's factual," she said thoughtfully as she scanned the AI-generated description ...
- AI in Healthcare Market Expected to reach $194.14 billion by 2030 | CAGR of 38.1%
AI in healthcare market was valued at $8.23 billion in 2020, and is estimated to reach $194.14 billion by 2030, growing at a CAGR of 38.1% from 2021 to ...
- ‘Do more with less’: Why public cloud services are key for AI and HPC in an uncertain 2023
This article is part of a VB Lab Insights series on AI sponsored by Microsoft and Nvidia. Don’t miss additional articles in this series providing new industry insights, trends and analysis on how AI ...
Go deeper with Google Headlines on:
AI medical services
[google_news title=”” keyword=”AI medical services” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Self-testing of artificial intelligence algorithms
- A ‘neutral’ hub for artificial intelligence in the Swiss Alps
Davos wants to become a research hub for “politically neutral” artificial intelligence to counterbalance the influence of China and the US.
- ChatGPT is just the beginning: Artificial intelligence is ready to transform the world
New chatbots capable of generating text and images from a few, simple prompts provide glimpses of how AI could change the workplace, education, superpower relations and our daily lives ...
- Artificial Intelligence Predicts Delirium Risk
During an ICU stay, the newly developed artificial intelligence (AI ... and plans to design a clinical trial to test the use of the algorithms — and how they could shape clinical care ...
- UAE lunar rover will test 1st artificial intelligence on the moon with Canada
The moon is about to host one giant leap in artificial intelligence (AI ... With the Canadian company's algorithm, "every single pixel in the image [will be] classified as a certain terrain ...
- Baltimore researchers say AI could help reduce disparities, improve access in health care
For a class they took last fall, they developed a concept for a “smart tampon,” an at-home cervical test they hope ... Just like people, artificial intelligence algorithms — and the large ...
Go deeper with Google Headlines on:
Self-testing of artificial intelligence algorithms
[google_news title=”” keyword=”self-testing of artificial intelligence algorithms” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]