CMU News: “CMU Researcher Uses ChatGPT To Execute Computer Tasks”

Large Language Models Can Solve Computer Tasks Using Keyboard, Mouse Actions

Stephen McAleer, a postdoctoral fellow in the Computer Science Department at CMU’s School of Computer Science, worked with his colleagues to demonstrate that large language models (LLMs) such as ChatGPT can be used to perform general computer tasks by completing keyboard and mouse actions.

McAleer, along with Geunwoo Kim and Pierre Baldi from the Department of Computer Science at the University of California, Irvine, recently published a paper detailing their work.

“Current AI provides transformative opportunities and at the same time raises formidable challenges,” Baldi said. “This work is on the side of the opportunities, showing how computer work can be greatly facilitated if not completely automated using large language models.”

Read the full article in CMU News.