Surveys

Statistical sources also include household surveys, specialized migration surveys, and passenger surveys. Household sample surveys are not necessarily focussed on migration but may include questions relevant to the topic, such as Labour Force Surveys, Health Surveys and Living Standards Measurement Study (Global Migration Group, 2017). A key advantage of specialized migration household surveys or migration modules is that they can be composed of different modules aimed at household members who are international migrants, citizens that have emigrated or citizens intending to emigrate.

Figure 4: examples of questions on migration from Mediterranean Household Immigration Surveys

P2C2F3-1_rev

(Source: MED-HIMS, 2019)

P2C2F3-2

(Source: MED-HIMS, 2019)

P2C2F3-3

(Source: MED-HIMS, 2019)

Case study: generating data on different migrant groups using labour force surveys (ILO, 2017)

The ILO has developed a labour migration module which is a rich source of data on the social and economic characteristics of immigrant and emigrant workers and has been integrated into the Labour Force Surveys of Moldova and Ukraine. The surveys used three questionnaires to gather information on migrant workers: one for collecting information on household members living abroad; another on household members who intended to migrate within six months; and one on members who had been abroad in the previous 24 months and had returned to the country.

Case study: Using survey data to demonstrate changes in migration over time, The Longitudinal Survey of Immigrants to Canada (LSIC) (UNECE, 2020)

Surveys can be either cross-sectional (conducted at one point in time, like a census) or longitudinal (follow a person or household members over time, e.g. panel data). Though longitudinal surveys have more potential for tracking migration processes over time, they are more difficult to implement than a cross-sectional survey. The Canadian Longitudinal Survey of Immigrants to Canada (LSIC) is specifically designed to study the integration of new immigrants and includes all migrants aged over 15 years who arrived in Canada during a specified time period. Statistics Canada used administrative sources, i.e., migration records, as a sampling frame. The data were collected at six months, two years, and four years after migrants arrived in Canada. The number of migrants surveyed fell from 165,000 respondents in wave 1 to 7,700 respondents in wave 3. A two-stage stratified sampling design for the first wave ensured that seasonal immigration patterns were also reflected in the sample. Tracing migrants for follow-up is more challenging than for the general population. At least half of migrants participating in wave 1 moved at least once in their first six months in Canada. There have been almost 170 publications based on the Canadian LSIC.

What are the different survey sampling strategies?

If the sample is large enough and drawn from a representative group of the population, inferences applicable to the entire population can be made. There are a number of sophisticated sampling techniques which can be used to capture rare populations, including probability and non-probability methods. In broad terms, probability samples mean that each sampling unit has an equal chance of being selected. One example of probability sampling is dual-sampling, which means locating sampling units with a higher proportion of persons from the target population, i.e., migrants, either using pre-existing data from a census or via sampling areas to discover them, and then oversampling in these units. This is particularly relevant for surveying migrants who tend to concentrate in specific geographic areas. Non-probability sampling methods include adaptative techniques such as snowballing, or asking respondents if they know any other people similar to themselves who might be interviewed. Non-probability sampling is useful for obtaining information on less prevalent or hidden migrant groups such as victims of trafficking or smuggling or irregular migrants but are limited in the generalizability of results due to the sampling bias (IOM, 2008).

What are individual-level alternatives to household surveys?

Passenger surveys are face-to-face interviews with a sample of persons crossing an international border on a given day or during a given period. The sheer volume of movement that takes place between borders means that only a small portion of passengers sampled will be migrants as opposed to visitors or travellers. These data collection methods are usually more successful for island countries without land borders (IOM, 2008). 

What are the strengths of survey methods?

The key strength of this source is the wealth of information collected relative to other data sources, which allows for in-depth analysis of the likely drivers and effects of migration (Global Migration Group, 2017). Surveys are an important tool for collecting migration data in countries where technical capacities for exploiting data from administrative sources are limited (IOM, 2008). They are usually designed and administered by NSOs which means the data comply with international statistical standards, are representative of the general population and can be analysed and disseminated in line with pre-existing conventions and protocols.

What are the limitations of surveys?

The low percentage of international migrants present in most countries means the sample size needs to be sufficiently large to identify enough migrants to allow for meaningful analyses and comparisons with non-migrants (Global Migration Group, 2017). Even with large enough sample sizes, the coverage of hard-to-reach migrant groups and gender-specific inequalities remain a concern. Depending on the country, these surveys might also be infrequent and/or costly (IOM, 2020a). Given that many surveys are either one-offs or planned on an ad-hoc basis, the data generated may not be comparable across surveys. Sample surveys are effective at measuring the characteristics and impact of migration, but less so at measuring the size of migration stocks and especially flows. A very large sample size is needed to measure specific country-to-country flows, and even then, depending on how weights are applied, invalid results are common (IOM, 2008). Household surveys also suffer from data quality concerns related to social desirability, respondent recall, respondent burden and question sensitivity, for example in relation to questions about earnings or sexual and reproductive health.  Regarding question sensitivity, it is important to note that respondents may be put at risk by simply responding to questions or by being seen with a survey enumerator (IOM 2020b). Emigration is particularly difficult to measure, since responses for household members living abroad are dependent on proxy respondents, as well as the possibility that entire households have migrated abroad.