It's been a familiar lament over the past few years: Even though millions of Americans are unemployed, companies across the country just can't find enough qualified workers.
New data suggest that although many companies continue to complain about the so-called skills gap, few are taking steps to fix it.
The CareerBuilder survey of 1,648 U.S. hiring managers and human resources professionals, released Thursday, found that nearly 80 percent of managers are at least somewhat concerned about the skills gap, just about 40 percent are doing anything to alleviate it.
The results come as the labor market continues to add jobs slowly, but unemployment remains high. The latest jobs numbers are scheduled to be released Friday.
(Read more: Visa abuse: What price for skilled labor? )
Experts say the weak job market has many companies feeling that they can demand a candidate who has a perfect record and plenty of relevant experience, and is willing to take a temporary job for relatively low pay.
"Sometimes we call that a purple squirrel," said Jorge Perez , senior vice president in the North American division of the staffing firm Manpower.
Manpower's own talent shortage survey, released earlier this year, found that 39 percent of employers are having trouble finding workers with the right skills, down from 49 percent in 2012.
Although the latest figures show there is still a problem, Perez said the drop shows that some employers have become more willing to accept that that the purple squirrel may not exist. If they want the perfect candidate, they may need to do some training-either in-house or in partnership-and offer a good salary, full-time status and benefits.
Matt Ferguson, CEO of CareerBuilder, said he also is starting to see a few signs that some companies are taking it upon themselves to build a more qualified, competitive workforce. Those efforts range from AT&T's decision to participate in a much-hyped, experimental effort to offer a low-cost graduate degree in computer science, to companies' increased willingness to hire a worker with some skills and to train them in others.
"I think they're getting to the point where they have to," said Ferguson, who co-authored a new book on navigating the skills gap and creating a competitive workforce.
In general, businesses appear to be working a little harder to find the best candidate, although not nearly as hard as they did when the job market was stronger.
Steven J. Davis, a management professor at the University of Chicago Booth School of Management, said his index of recruitment intensity-essentially, how hard employers are looking for the right people-has only partially recovered since falling sharply amid the recession and financial crisis in 2008 and 2009.
(Read more: From low to no wage: Shutdown hammers working poor )
Employers don't yet seem to be pressured to hire any one candidate because they see that so many people are still looking.
"Employers know that if they don't fill a job today and really have a tremendous need, they can fill it in a month," he said.
Ferguson at CareerBuilder said there are some legitimate concerns about a mismatch between available jobs and candidate. The Great Recession led to millions of job cuts in fields like construction and manufacturing, and the advent of technology has reduced the need for some administrative workers. That's presumably left some workers possessing skills that no one needs anymore.
Meanwhile, the push to keep down costs also has left some companies looking for one person with a multitude of skills-marketing, data analysis and information technology, for example.
Still, some experts say that the rampant complaints about unqualified workers in the aftermath of the recession are overblown.
Paul Osterman, a management professor at MIT's Sloan School of Management, recently completed a nationally representative survey of about 1,000 manufacturers.
He found that only about 25 percent of companies were having trouble finding workers, as measured by the company's having a job vacancy for three months or more.
(Read more: Help wanted: No jerks, please! )
Those companies that were having trouble tending to be smaller and more innovative, he said, pointing to a legitimate concern that a minority of companies are in need of specialized skills that are hard to find.
"I'm not telling you there's zero problem," he said. "I'm telling you the level of hysteria is wrong."
Broader skills gap
Still, others are argue that there are longer-term worries about how skilled the American workforce is generally when compared to other economies with which the U.S. competes.
A detailed worldwide report on worker skills, released last month by the Organization for Economic Development, found that the United States ranked below average among OECD member countries in literacy and numeracy, which measures math skills.
Andreas Schleicher, the OECD's deputy director for education and skills, said the results were particularly concerning when looking more closely at younger American adults. They tended to be about as skilled in math and reading as their grandparents, while in other countries younger adults were outperforming older ones.
"In most countries there has been a significant sort of generation gap," Schleicher said. "You don't see that for the United States."
More From CNBC