University of Tokyo

Abstract
Survey Number 0670
Survey Title Questionnaire on Life and Social Awareness (Survey Techniques Research), 2007
Depositor Recruit Works Institute
Restriction of Use For detailed information, please refer to 'For Data Users' on the SSJDA website.

- Apply to SSJDA. Depositor's approval is required.
Educational Purpose Available for both research and instructional purposes.
Period of Data Use Permission One year
Access to Datasets Download
SSJDA Data Analysis Not available
Summary The most reliable of social surveys is the “drop-off interview survey of subjects randomly selected from the Basic Resident Register.” However, due to the 2006 revision of the Basic Resident Registration Act, searches of the Basic Resident Register are prohibited, except for surveys of high interest to the public, making such surveys difficult. Furthermore, due to an outsized increased interest in protecting personal information in recent years and an increase in households where no one is present during survey times due to social advancements for women, there has been a significant decrease in the response rate for drop-off surveys, and the “representativeness” characteristic of such conventional survey techniques is already being lost. There is no expectation that this situation will improve in the future, so more reliable survey techniques are being sought.

This study was conducted using different techniques with the same questions, and by comparing the results, examined possible replacements for conventional survey techniques.

This study was the “Survey study of the efficacy of Internet surveys” conducted for two years from 2007 to 2008. The Recruit Works Institute commissioned this study to the Institute of Social Science at The University of Tokyo, which organized a study group (chairperson: Hiroki Sato).

In a phase 1 survey conducted in 2007, five survey techniques were used simultaneously with the same questions. These five techniques were a (1) random mail survey, (2) mail survey (access panel), (3) web panel survey A, (4) web panel survey B, and (5) web panel survey C. Of these, (3) and (4) used access panels registered with different survey companies and (5) used an access panel from a sweepstakes mailing list. The random mail survey in (1) was used for comparison criteria.

In addition, some questions have been extracted from the survey questions for comparison with the answers of existing surveys, using conventional survey methods. The existing surveys are in (6) to (11) below. In addition, to avoid response rates dropping owing to an excessive number of questions, the minimum number of questions needed for analysis was used.

In phase 2, a survey was conducted in 2008 to practically verify the possibility of web panel survey based on the phase 1 survey. Specifically, for the purpose of identifying the actual state and attitudes of working individuals of their work, a large-scale survey using the drop-off placement (self-administered) method and area sampling was conducted, and, in parallel, web surveys of the same scale and with the same questions was conducted using registered access panels.

These surveys were conducted by Recruit Works Institute for this study based on study group discussions. In the report, a cross-comparison of the survey data and a detailed comparison with a highly representative conventional survey is made.

What is compiled here are the five surveys conducted in the 2007 phase 1 survey. All of the five surveys used the same questions and were collected into one data set.

The comparison of partially excerpted existing surveys (6) to (11) and cited questions are as follows (question numbers are those in the mail-in questionnaire).
 (6) “Employment Status Survey” (2007: Ministry of Internal Affairs and Communications, two-stage stratified random sampling, drop-in interview)
⇒ Q1, Q2, Q9, SQ9-A1/A2/A3/A4, SQ9-B, Q16 (questions on life consciousness)
 (7) “Working person survey” (2006: Recruit, area sampling, placement (self-administered) method)
⇒ SQ9-A5/A6, Q11 (work status, employment attitudes, etc., and questions on basic attributes)
 (8) “Japanese General Social Surveys” (2007: two-stage stratified random sampling, interview placement)
⇒ Q5, Q6, Q8 (work status, employment attitudes, etc., and questions on basic attributes)
 (9) “Post-Election Survey for the House of Councillors Election” (2007: Association for Promoting Fair Elections, two-stage stratified random sampling, drop-in interviews)
⇒ Q3, SQ3-1/3, Q7 (questions on political awareness)
 (10) “2006 Communication Usage Trend Survey” (2006: Ministry of Internal Affairs and Communications, two-stage stratified random sampling, mail survey)
⇒ Q14 (questions on survey participation trends, state of Internet use, and state of access panel registration)
 (11) “Survey of work styles of people in Japan” (2005: Japan Institute for Labour Policy and Training, stratified two-stage random sampling, placement (self-administered) method)
⇒ Q15, SQ15-1/2 (questions on survey participation trends, state of Internet use, and state of access panel registration)
Data Type quantitative research: micro data
Universe Men and women aged 20 to 59 years
Unit of Observation Individual
Sample Size
Number distributedNumber of responsesResponse rateNumber tallied
(1) Random mail survey:3,50075321.5%753
(2) Mail survey (access panel):1,3401,10882.7%986
(3) Web panel survey A:2,6661,20145.0%1,000
(4) Web panel survey B:2,0051,47273.4%1,000
(5) Web panel survey C:29,9952,0887.0%984
Total4723
Date of Collection 2007-10-11 ~ 2007-10-31
(1) Random mail survey: 2007/10/11 - 10/31
(2) Mail survey (access panel): 2007/10/11 - 10/31
(3) Web panel survey A: 2007/10/12 - 10/16
(4) Web panel survey B: 2007/10/12 - 10/16
(5) Web panel survey C: 2007/10/12 - 10/16
(1) Random mail survey: 2007/10/11 - 10/31
(2) Mail survey (access panel): 2007/10/11 - 10/31
(3) Web panel survey A: 2007/10/12 - 10/16
(4) Web panel survey B: 2007/10/12 - 10/16
(5) Web panel survey C: 2007/10/12 - 10/16
Time Period 2007 ~ 2007
Spatial Unit tokyo
Tokyo (the Greater Tokyo Area - within 50 km from the center of Tokyo)
Sampling Procedure Mixed probability and non-probability
<Settings, etc. for number of questionnaires sent/distributed>  
(1) Random mail survey: The goal was to collect a sample of 1,000. Assuming a less than 30% response rate, questionnaires were distributed to a total of 3,500 people.
(2) Mail survey (access panel): The goal was to collect a sample of 1,000. Each survey company with knowhow decided distribution number settings and solicitation methods.
(3) Web panel survey A: 〃
(4) Web panel survey B: 〃
(5) Web panel survey C: 〃

<Register (sampling)>
(1) Random mail survey: voter registration lists, random sampling
(2) Mail survey (access panel): registered access panel
(3) Web panel survey A: registered access panel 
(4) Web panel survey B: 〃
(5) Web panel survey C: sweepstakes mailing list

<Distribution>
(1) Random mail survey: Target area was stratified seven ways and number of survey sites proportionally sampled according to population size of each strata (the 2005 Population Census of Japan).
(2) Mail survey (access panel): Target area was stratified seven ways as in (1), and distribution was done according to gender in 10-year increments, according to population size of each strata.
(3) Web panel survey A: 〃
(4) Web panel survey B: 〃
(5) Web panel survey C: 〃

<Receiving responses>
(1) Random mail survey: Distribution cells in excess of expectations after end of survey period* randomly sampled
(2) Mail survey (access panel): 〃
(3) Web panel survey A: 〃
(4) Web panel survey B: first-come, first-serve
(5) Web panel survey C: same as (1)
*“Cell” refers to groups of respondents divided into 10-year “age groups x gender x area.”
Mode of Data Collection Self-administered questionnaire: Paper
Self-administered questionnaire: Web-based (CAWI)
<Survey method (measurement method)>
(1) Random mail survey: by mail
(2) Mail survey (access panel): 〃
(3) Web panel survey A: on Internet
(4) Web panel survey B: 〃
(5) Web panel survey C: 〃
Investigator Recruit Works Institute
Access panel survey carried out by:
 (2) Mail survey (access panel): INTAGE Inc.
 (3) Web panel survey A: INTAGE Inc. (Yahoo! Research)
 (4) Web panel survey B: Macromill
 (5) Web panel survey C: Ergo-Brains
DOI 10.34500/SSJDA.0670
Sponsors (Funds)
Related Publications (by the Investigator) Please refer to the abstract in Japanese.
Related Publications (based on Secondary Analysis) List of related publications (based on Secondary Analysis)
Documentation Questionnaire
Major Survey Items There were five questionnaires, all with the same content: (1) random mail survey, (2) mail survey (access panel), (3) web panel survey A, (4) web panel survey B, (5) web panel survey C (question numbers correspond to mail survey questionnaire).

- Gender, marital status (Q1)
- Age group (Q2)
- Voting behavior in the House of Councillors election on July 29 (Q3)
- In-person voting, early voting/absentee voting (SQ3-1)
- The most important issue to respondent at the time of voting (SQ3-2)
- Political party of the candidate voted for in electoral district election (SQ3-3)
- Level of trust in pension system (Q4)
- Feeling that respondent’s income tax is too high or too low (Q5)
- Pros and cons of policies to reduce household income inequality (Q6)
- Political party supported (Q7)
- Men work outside, and women protect the home (Q8 (1))
- Whether generally people can be trusted (Q8 (2))
- Stratum identification (Q8 (3))
- Work, attending schooling, housework (Q9)
- Employed/self-employed status, employment status (SQ9-A1)
- Hours worked this past week (SQ9-A2)
- Annual income from this job (SQ9-A3)
- Occupation type (SQ9-A4)
- Degree of job satisfaction (SQ9-A5)
- Reason for working (SQ9-A6)
- Whether respondent wants to have income-earning job (SQ9-B)
- Number of employed household family members aged 18 to 59 years (Q10)
- Retirement experience, number of retirements (Q1(1)
- Survey organizations respondent would respond (Q12)
- Acceptable survey method (Q13)
- Experience using Internet in the past year (Q14)
- Whether or not registered as a respondent of a private survey company access panel (Q15)
- Registered respondent type (SQ15-1)
- Survey response frequency (SQ15-2)
- Schooling situation, highest level of educational attainment (Q16)
Date of Release 2010/09/09
Topics in CESSDA Click here for details

SOCIETY AND CULTURE
Topics in SSJDA Society/Culture
Other
Version 1 : 2010-09-09
Notes for Users