University of the Philippines Diliman. (INQUIRER FILE PHOTO)
MANILA, Philippines — The University of the Philippines (UP) School of Statistics flagged surveys with unclear methodologies on Monday, tagging it as “kalye (street) surveys” with “pervasive abuse of survey methodologies.”
While it did not specify which surveys they were referring to or whether they were related to the May 9 elections, faculty of the UP School of Statistics, in a statement, said entities conducting and promoting their own research with ambiguous data-gathering methods have a “cavalier disregard for the principles of data gathering.”
“We have been observing these practices, including surveys not based on random sampling, such as videos of ‘kalye surveys’ being done by some vloggers and suspicious online surveys, especially on Twitter and Facebook,” the faculty said.
“We also witness PR companies, private individuals, and even some media organizations publishing results of surveys with unclear methodologies,” they added.
According to the school faculty, though surveys are expected to reveal facts, beliefs, sentiments, and opinions based on a representative sample of the population, “the quality of any inference cannot exceed the quality of the methodology on which it is based.”
The faculty members also reminded the public that survey sample selection and data collection can generate “biased” results.
“[This] happens when the sample tends to favor a segment of the population. Data collection processes may also generate bias, such as when an interviewer purposely affects the answers of the respondents” they said.
“Biased methodologies will only give biased results,” the UP School of Statistics added.
The educators then called on the public to be critical of surveys and to not accept them as they are.
“Be mindful if the sample is of appropriate size based on, but not limited to, a target margin of error, level of confidence, and nature of the target population,” explained the school.
They also reminded the public to ask these questions when assessing surveys: “How was the sample selected? Which sectors of the population, if any, are being represented? What events surround the period of data gathering? When facing an interviewer, was the respondent interviewed in a neutral yet professional tone? What are the control mechanisms implemented to ensure accuracy of the protocols in data collection?”
“These are only some indications of survey operations with proper implementation and controls,” the school said.
The faculty members then assured that the UP School of Statistics will remain vigilant and continue to fight “for the ethical practice of statistical science.”
RELATED STORY:
Pulse Asia’s December survey: Marcos and Duterte-Carpio team is top choice