NLSC: Driving the definition of standards for language proficiency tests

We expect that, when we conclude our pilot phase and become a live organization, NLSC membership will grow rapidly, to anywhere between 16,000 and 30,000 volunteers. And we will need to certify every one, to make sure they have sufficient language skills to meet the needs of the agencies we will be serving.

This presents two challenges: language testing capacity and language tests of consistent quality.

If we re-certify a person’s language skills every three years, that would mean we would be conducting at least 5,000 tests per year (assuming only 16,000 members), and that doesn’t include certifying new members who come on board. Challenge #1: Current government and private sector resources cannot handle that additional load, so what are our options?

In addition, the Department of Defense currently has tests for reading, listening and speaking for about 15 languages. According to the U.S. Census, there are over 500 languages spoken in this country. That leaves "only" 460 languages without tests. Challenge #2: Who develops these tests and how can we ensure that they are consistently good tests?

Enter ASTM International. ASTM International is one of the largest voluntary standards development organizations in the world, similar to Underwriters Laboratories. Originally known as the American Society for Testing and Materials, the ASTM was formed over a century ago, when a group of engineers and scientists got together to address the need for standards in the rail industry. It has long since expanded to cover hundreds of product and service standards.

ASTM’s role is to facilitate standards, not enforce them and not to certify anything. Those tasks are left up to the industries that embrace the standards.

We began realizing the need for standards in November 2007, during the organizational phase of the NLSC when we were trying to define our language certification plan. The NLSC worked with the ASTM to launch a subcommittee to specifically address Foreign Language Proficiency. Dr. Bill Rivers, our Chief Linguist, chairs the committee. Our goal is to define standards for language proficiency tests … measurable standards that can be incorporated into contracts awarded to companies to create tests.

The subcommittee got rolling in December 2008. Those involved include 25 to 30 individuals from government agencies that need individuals with language skill, and companies that are involved in language testing. In other words, the people involved have a vested interest in the outcome. Dr. Rivers expects draft standards to be ready by the end of this summer. He noted that the process has been remarkably smooth, compared with another ASTM committee he was involved with that took six years.

Standards will make sure that the NLSC does not create bottlenecks in the existing government agencies that test language skills. Why? Because we will be able to test skills ourselves (or outsource that task) and we will be able to contract out the creation of tests for additional languages to any company willing to commit to those standards.

And standards will not only benefit the NLSC. They will be a great help to the entire language industry. If a test meets the benchmarks, any agency adopting those standards can reliably use that test.