A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text.
In a world of novice photographers and videographers, capturing a deluge of content via their smartphones and handheld devices, there is a need for an intelligent, easy-to-use tool for automating the creation of movies and video montages. To date, many quality videos still rely on professional frame-based editing tools to manipulate raw footage and produce a coherent video with a captivating storyline.
A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text. Using words and text editing, the tool automatically determines which scenes or shots are chosen from a repository to illustrate the desired storyline. The tool enables novice users to produce quality video montages in a simple and user-friendly manner that doesn’t require professional video production and editing skills.
The team is set to present their work at ACM SIGGRAPH Asia, held Nov. 17 to 20 in Brisbane, Australia. SIGGRAPH Asia, now in its 12th year, attracts the most respected technical and creative people from around the world in computer graphics, animation, interactivity, gaming, and emerging technologies.
While existing video editing tools still demand knowledge in video processing and editing, the researchers’ new method allows novices to create videos that tell stories more naturally. Write-A-Video, say the researchers, allows users to create a video montage by simply editing the text that accompanies the video. For example, adding or deleting text, and moving sentences around convert to video-editing operations, such as finding corresponding shots, cutting and rearranging shots, and creating a final video montage result.
“Write-A-Video uses current advances in automatic video understanding and a unique user interface to allow more natural and simpler video creation,” says Professor Ariel Shamir, Dean of the Efi Arazi School of Computer Science at IDC Herzliya. “With our tool, the user provides input mostly in the form of editing of text. The tool automatically searches for semantically matching candidate shots from a video repository, and then uses an optimization method to assemble the video montage by cutting and reordering the shots automatically.”
“Write-A-Video also allows users to explore visual styles for each scene using cinematographic idioms generating, for example, faster or slower paced movies, less or more content movements, etc.” explains Dr. Miao Wang from Beihang University.
When selecting candidate shots from the video repository, the method also considers the aesthetic appeal of the shots, choosing those that are ideally lit, that are well focused and are not blurry or unstable. “At any point, the user can render the movie and preview the video montage result with an accompanying voice-over narration.” says Professor Shi-Min Hu from Tsinghua University.
The team’s research shows that intelligent digital tools combining the abilities of humans and algorithms together can assist users in the creative process. “Our work demonstrates the potential of automatic visual-semantic matching in idiom-based computational editing, offering an intelligent way to make video creation more accessible to non-professionals,” says Shamir.
For the study, the approach was tested on various pieces of themed text and video repositories, with quantitative evaluation and user studies. Users without any video editing experience could produce satisfactory videos using the Write-A-Video tool, sometimes even faster than professionals utilizing frame-based editing software. At SIGGRAPH Asia, the team will demonstrate the Write-A-Video application and showcase a variety of examples of text-to-video productions.
The Latest on: Write-A-Video
- An Emmy award-winning TV producer and productivity coach shares how leaders can better manage their timeon March 5, 2021 at 10:29 am
Paula Rizzo is a fan of the old-fashioned paper to-do list, swearing by it in her 20 years in television. Here's how else she saves time and stress.
via Bing News
The Latest on: Videos from themed text
- Due to climate change, Miami Beach moving away from palm trees to create more shadeon February 26, 2021 at 3:13 am
Whether swaying in the background of a Super Bowl glamour shot or printed on Art Deco-themed postcards, palm trees are synonymous with the sun-and-fun allure of Miami Beach. In a city with nearly ...
- Bureaucrats from federal to local governments have weighed-in...on February 24, 2021 at 11:22 am
Bureaucrats from federal to local governments have weighed-in on opening schools for in-class learning. What is your opinion — should all Walnut Creek schools fully reopen immediately? Photo by ...
- Office Insiders can now generate PowerPoint presentations from Word documentson February 24, 2021 at 10:20 am
Microsoft is adding a nifty new intelligent feature to Word on the web that will let users automatically convert text-based documents to PowerPoint presentations. This capability is currently ...
- Word on the web can now generate PowerPoint presentations from text fileson February 24, 2021 at 3:20 am
Microsoft is rolling out in preview form the ability for Word on the web to transform text-based documents to multi-slide PowerPoint presentations, complete with multimedia content.
- Want to crush it on TikTok, Instagram or YouTube? 7 tips for video creationon February 24, 2021 at 2:03 am
Tools such as Instagram Reels, TikTok and YouTube Shorts are becoming invaluable to real estate agents — especially because they're free. With a few of these best practices, you can ramp up your views ...
- UCLA Sports Star Dismissed After Racist Texts, Videos Surface About Alleged Ex-GFon February 23, 2021 at 9:00 pm
Chris Weiland is accused of unleashing racists rants on video & in texts after learning that his girlfriend cheated on him with a Black man. The ending of a relationship can cause people to do and say ...
- Reserve Bank of India's rap video warning against banking frauds is the coolest thing you will watch today --Here's the videoon February 18, 2021 at 11:27 pm
"A little caution takes care of a lot of trouble. Never respond to requests to share PIN, OTP or bank account details. Block your card if stolen, lost or compromised," Reserve Bank of India (RBI) has ...
- Gisele Fetterman introduces PA Kindness Poem Projecton February 17, 2021 at 11:23 am
Throughout the year, PHC will encourage participation in the project by regularly sharing kindness-themed quotes on Facebook ... posted on social media in video, text or image formats and can ...
- Review: Beware the Text, and Other Tales From ‘Smithtown’on February 14, 2021 at 10:40 am
The technology that binds us is in fact the theme. Phone books may be things of the past, but “Smithtown” treats modern communication platforms — Zoom, email, Facebook, text messaging ...
- Virtual game nights offer trivia, charades, drawing, and moreon February 10, 2021 at 9:03 am
Who doesn’t like a good game every now and then? For the past year, people have been forced to get a bit more creative with social gatherings, with many flocking to the virtual scene online.
via Bing News