Localization Testing: A Hidden Goldmine Beyond Localization and Testing

As a developer, you may have implemented functional testing of your product; possibly you've even done it yourself. Since you’re reading this article in English on an international tech-focused website, we’ll also assume that you’ve implemented localization into your product, or at least you're considering it. But did you know that high-quality localization involves localization testing as its final step? 

Localization Testing Services. Image: © Alconost

Here at Alconost we’ve been localizing games, apps, and websites for 18 years. We've seen the pitfalls of localization and localization testing, and that’s why we’ve decided to share them with you. Read on to understand what localization testing is (and also what it isn't), how to prepare for localization testing (spoiler alert: a well-prepared build can significantly reduce localization testing costs!), and our perspective on why delegating localization testing to a language service provider is a worthwhile investment.

What is localization testing?

Localization testing is a thorough inspection of the translated app, game, website, or other product for the purpose of ensuring that it contains no semantic and contextual errors, mistranslations, or linguistic and visual issues. Localization testing also checks for correct usage of date and time formats, UI elements, currencies, measurements, punctuation marks, and overall vocabulary. 

Localization testing helps identify and eliminate semantic and technical errors in a product’s textual content before the localized version of the app or game reaches users. 

For those who love precise term definitions: although LQT (localization quality testing) and LQA (localization quality assurance) mean roughly the same thing, a tiny difference can still be distinguished. LQA generally means that testers go through localized strings and compare them to the originals, while LQT refers more to checking the localization within the product. It's best to clarify these subtle nuances with the particular localization testing company you’re looking to work with: make sure you're talking about the same thing!

How is localization testing different from functional testing?

Which type of testing should be done first? Can you assign both functional and localization testing to a single person? Let’s find out how these two types of testing coexist, and what skill sets you should look for when hiring skilled professionals for both roles.

Functional testing

Functional testing ensures the proper operation of each application feature. It involves checking the website, game, or app against predetermined standards of performance. In short, this type of testing looks at whether the app or system is functioning according to the technical expectations outlined. 

Functional testers have a solid technical background under their belt. Aside from an impressive hard skill set, this type of testing requires attention to detail and strong time-management skills. But it doesn't require delving deep into every intricate nuance of the product’s context, or of the target market’s cultural aspects. 

Localization testing

In contrast to functional testing, localization testing is less a technical procedure than it is a careful read-through to check how content will be perceived. 

Testing of this type can be conducted either by going through the product using scripted scenarios provided, or by checking screenshots of the product in use. Errors that localization testers typically look for include:

1. Untranslated or incorrectly translated text
2. Inconsistency or inappropriate use of terminology — for example, different names used for the same function or object
3. Inconsistencies in style between the translation and the source text
4. Errors in grammar, spelling, and punctuation
5. UI issues — for example, when localizing from English, keep in mind that text in some target languages (such as German) may not fit in the space originally allocated
6. Incorrect rendering of specific characters, such as glyphs
7. Incorrect formatting of numbers, currencies, and dates — for example, 9/5/2022 refers to the 9th of May in European countries, but it means September 5 in the USA
8. Errors that make further testing impossible — for example, a game constantly crashes at a certain point or when opening a certain window

If you’ve been paying close attention, you may be a little confused by now. Doesn’t the last point in the list above refer to the kind of bugs that functional testing should deal with? Absolutely, and this is where functional and localization testing intersect. But our advice is not to rely on localization testing alone. While localization testing does indeed help to detect critical functional bugs, localization testers simply don’t have the technical background to alter the code to make the product work properly. And vice versa: while functional testing is crucial for localized versions of any product, functional testers are usually not native speakers with a thorough understanding of the target languages. Consequently, without native speakers to check your localization you can never be sure whether your product is truly ready to be introduced to a foreign audience. 

In a nutshell, the reason why a functional tester is unlikely to succeed in localization testing and vice versa is because these two services require different skill sets, as you can see in the table below. 

Picture 1: Skill sets for different types of testing. Image: © Alconost

So don’t hyperfocus on minimizing expenses — as you can see, functional and localization testing are designed to check different aspects of the product. That’s why experts in both fields have different core competencies. An actual human being who is a native speaker of your target language has the best feel for particular shades of meaning, like sarcasm, and particular cultural nuances, like politically correct jokes. 

When preparing for an international launch, both localization and functional testing are vital because they ensure that no technical or linguistic errors slip by before the release. Testing in general is designed to ensure the best first impression possible when your product goes live (and you can’t make a first impression twice!), so we recommend that you not neglect testing, either functional or linguistic! Both are important.

Need an example of where localization and functional testing intersect? One time Alconost was testing localization of a web project that had an address form template. What could possibly go wrong, you might think? But the devil is in the details, and in this case it was the order of the address elements. For example, in the United States the address line starts with the house number, while in Germany the street name goes first. For a proper localization the order of the variables must be changed. This is the kind of mistake that localization testing can detect, but only the developers themselves can fix.

Automation, AI, & localization testing services

Combining automation with manual operations is a common practice for functional testing, where creating automated test scripts is recommended to accelerate the process. Handy tools that simplify routine tasks are also widely used in localization. Glossaries, computer-aided translation (CAT) tools, and translation management systems (TMS) help translators do the bulk of the initial work. With localization testing, however, it's not quite that easy: here you need someone from the target culture who's a native speaker of the target language to do the bulk of work. 

Anya Zanevskaya, a Localization Team Lead at Alconost, shared her thoughts on implementing AI in localization testing:

“We need to remember that automation doesn’t come out of nowhere — there's still human input behind the scenes. You can probably train AI to detect functional mistakes and report them, but when it comes to the linguistic aspect of the project, the participation of an attentive native speaker who's able to see the whole picture and be aware of the context is still the best scenario. The fact is, we do employ some AI-based technologies in certain localization projects, but even here we always invite a native-speaking editor who polishes up the final result. All this confirms my view that at this point AI can't replace humans in localization testing.“

Localization testing is the final step in the localization workflow, and it is still humans who put the finishing touches on the translation before it goes live. 

The chief purpose of automation is to simplify the process and reduce the client’s expenses. However, you can actually cut them down yourself at the stage of preparation for localization and localization testing.

How to prepare for localization testing

1. Long before the localization stage, develop your product with internationalization in mind. Write code that allows for bidirectional text and non-Latin typographic features, and which supports different time formats, numeric formats, sorting, etc. Use Unicode to allow for different character code architectures. 
2. Once you implement localization into a test build, outline a clear methodology for testing so that neither you nor the localization testers miss anything. Prepare documentation and plan how the game, app, or website will be tested. This helps tremendously, and this kind of documentation doesn't have to be humongous. For example, when we were conducting LQT of one product’s website and mobile app in over 30 languages, the customer provided us with substantial yet concise instructions - just 2 pages - that were arranged in a numbered list of consecutive steps. Using it we were able to breeze through the testing - no devil in these details! 
3. If you need particular language versions to be tested with certain crucial nuances in mind, outline separate testing steps for those languages. 
4. For game localization testing, prepare a separate build for testers with built-in cheat codes so the translators can easily play through it. When we did localization testing for the game Mahjong by Vizor, cheat codes and in-game coins helped our testers quickly go through the game zones specified. This meant not a single hour was wasted on figuring out how to get to the specific level that actually required localization testing. In addition to cheat codes, you can also provide a pre-recorded gameplay video. Once again, that's what Vizor did when they needed to check the translation of the UI elements only. Not only was it convenient, it also helped reduce the testing time from 4 hours to 1!
5. If your project requires special equipment (such as a VR headset), it’s in your best interests to provide it so that the language service provider can select a translator based on their niche experience rather than on whether they have a rather uncommon piece of equipment. For these cases you'll also need to provide technical support for the device on occasions when the test build breaks down or gets buggy and prevents translators from conducting further testing.
6. If your project is a game, help localization testers to get into the spirit of it by at least showing them a game trailer. If your project is an app or service, give testers some clues on style — for example, whether users should be addressed formally or informally. This is especially important when the source language is English, which has a universal 'you,' and the target language is French, Spanish, or German, where there are specific forms of 'you,' depending on how formal or informal you need to be. For example, we considered this issue of appropriate address when localizing a сhildren’s claymation-style game from RUD Present: the source language was English, with target languages including French and Spanish. A formal style of address would sound odd in a game like this, wouldn’t it? 

We wouldn't say that preparation is something you can’t skip. But consider that a localization testing company usually bills at an hourly rate for localization testing services. If the localization quality assurance tester has to slog through the entire game or app to check one screen of dialogue, you'll simply pay for more hours than you could have. Simplifying the process in advance means you save yourself money.

3 reasons to outsource localization testing to a language services provider

As with pretty much any service, it’s always smart to delegate what you can’t do on an advanced level to a person or enterprise with niche expertise in the solution you're looking for. In this article we elaborate on the arguments in favor of choosing a localization testing company. Below we’ll walk you through the key 3 reasons.

Picture 2: Reasons to outsource localization testing. Image: © Alconost

1. Native-speaking linguists with niche experience

When you order localization testing services from a language services provider, testing is performed by professional translators who are, first, native speakers of the target languages, and second, experienced testers who are assigned to the project based on their previous experience in your particular niche.

For example, at Alconost we carefully select testers from our team of more than 600 native-speaking translators, taking into account their experience with particular types of software, translation quality scores, and client feedback. Note that for localization testing we select translators from among the top specialists who are already part of our team and whose language proficiency is indisputable. This ensures a level of quality that ordinary freelance or community testing platforms cannot guarantee.

2. Smooth workflow

Localization vendors use modern translation management systems and approaches that take the localization process to the next level. When outsourced to a language services provider, localization is managed on a cloud platform that offers convenient workflow management tools. The localization manager sets a schedule that the team diligently follows. 

In addition, if you order localization services and then decide to test your localizations using the same team of translators, you save time. That’s because the team is already familiar with the context and knows the key information about your product. On top of that, the localization manager asks the right questions to unpack your priorities and key objectives for localization testing, which helps to wisely manage the time allocated for testing. This helps to reduce the cost — as we mentioned, localization testers are usually paid an hourly rate, so time literally becomes money. ;-)

An experienced localization manager also knows the bottlenecks of different language pairs and determines the nuances to consider first and foremost. For example, an unique feature of Japanese is that there are no spaces between the words. When localizing from English to Japanese, you need to take this into account and pay special attention to paragraphs and strings. It's the localization manager's job to prioritize checking certain aspects of the target language and ensure a smooth localization testing workflow. 

3. Minimal back-and-forth

As the cherry on top, you only need to be actively involved in the process at the initial stages of briefing and setting up the localization process. After that you only keep in touch with the localization manager, who communicates with the rest of the localization team, sets deadlines, monitors the workflow, and clarifies critical questions when necessary. 

Final thoughts: What makes localization testing a worthwhile investment?

Human beings are social animals who thrive on communication, but that communication differs from one culture to the next. How your product communicates with its end users determines their loyalty. Localization testing is crucial because it ensures that your product speaks your users’ language, eliminates potentially offensive or inappropriate jokes, and embraces the power of local humor. If your users enjoy your high-quality product enough to stay and keep using it, they’ll be sure to tell their friends about it, as well!

With the high number of skills required to perform high-quality localization quality assurance, we understand that it can be challenging for companies to set up the process internally. Alconost offers a solution: professional localization testing services backed up by 18 years of experience in the translation industry, a pool of 645 native-speaking translators working with 100+ languages, and reliable services endorsed by over 2000 satisfied clients worldwide. Get a quote by filling out this form, or book a free consultation with our team to find out how we can help with your particular project.