We had so many great questions from the webinar that it may take us a few days to answer them all. We will be adding to this blog as we answer more questions, so please feel free to check back to see more Q&A.
Does MetroQuest have case studies and examples of how they have implemented some of these strategies on any commuter rail and railroad projects in the planning phase and with projects under review/approval with FRA? I see that FHWA and other agencies have utilized but curious with usage during railroad planning.
MetroQuest has been used on multiple rail planning projects, from commuter rail to freight-focussed studies. Whether it’s alternative alignments, new investments or policy projects, online engagement can be extremely helpful in these cases since the area of influence of these projects is often so vast that public meetings are unlikely to attract stakeholders from across the region. I would suggest you reach out to Derek Warburton at firstname.lastname@example.org or toll free at +1 855-215-0186 to talk about specific project types and approaches.
What information does MetroQuest survey collects to assess diversity of demographics participation?
MetroQuest always includes questions about demographics. These are placed at the end of what is typically a five-minute experience since we have discovered that most people are more than happy to provide this information after they have participated since they are then engaged in the subject matter and interested in the outcomes. It’s up to the client to decide what information to collect to help them gain confidence in the diversity of the engagement. It’s a best practice to evaluate the demographics of the participation half way through the engagement period to see if there are any gaps. There is then time to use targeted promotions and “go to them” engagement strategies to fill in these gaps to meet the diversity goals of the project.
Where to get more info on MetroQuest tool itself. Applications etc.
Our apologies to those of you who wanted additional information about the MetroQuest itself. Due to the educational nature of this particular webinar we were not able to provide much detail on the software. The best way to learn more would be to attend our next webinar which is specifically about MetroQuest and how to optimize online engagement for the best results. You may also feel free to reach out to Derek Warburton at email@example.com or toll free at +1 855-215-0186 to learn more.
If you have people doing the survey at a public meeting on their phones, have you had any issues with overloading the internet bandwidth?
No, MetroQuest is a relatively light web-based application which loads quickly. Often at public meetings there are iPad type kiosk stations set up at the back or side of the room where people can participate when they wish so only few people participate at once. If the process involves people using their own phones at a meeting some people will be using the mobile network to connect and others may be using the local wifi. Depending on it’s capacity, the local wifi may get bogged down but it’s not a great concern since it’s only likely to be a second or two of delay.
Would you describe the Westport survey as a statistically-valid survey of a certain group? Being an online survey, were participants able to forward the survey link to like-minded people?
Surveys that are open to the public are not like formal market research surveys where a small randomly selected group of people are polled about a topic. Generally government agencies are keen to engage as many people as possible and are required to allow anyone to participate. For these reasons, MetroQuest is optimized to engage the larges number and diversity of participants possible.
With that being said it’s also important for agencies to be confident that a small and vocal minority is not able to skew the results. Yes, people are free to help spread the word no matter which side of the debate they may be on and generally we find that the results of broad engagement closely match the diversity of views in the community and that the vocal minority remains a minority in the results.
In fact in the Westport project they also conducted a statistically-valid telephone survey and the results were consistent with the results of MetroQuest.
MetroQuest has safeguards that prevent abuses like ballot-stuffing (see response to that specific question for details). Clients also receive data on the demographics of participants so they can easily see if there are cohorts that are over or under represented in the participation. Clients can see the results from each cohort isolated and also calibrate the results for the actual make-up of the region.
How do you recognize/reconcile “stuffing the ballot box” by special interest groups when using online polls? How do you protect against coming to conclusions that really don’t reflect the community’s opinions?
Planning processes can be controversial and abuse is always a possibility. MetroQuest has tools and techniques to identify and help mitigate ballot stuffing in order to protect the integrity of the results. It’s very rare but, if it happens, these tools allow potential abuse to be easily recognized and nullified. These tools combine IP tracking and several other data points on user activity. These tools allow clients to be confident that someone isn’t, for example, participating 500 times in an attempt to skew the results.
In addition to these measures, it’s important to ensure that there is a balance of demographics engaged in the process so that one group does not dominate the results. MetroQuest allows clients to track participation by demographic categories and oftentimes midway through an engagement process efforts are made to ensure that the gaps are filled in using targeted promotional techniques.
Generally, with such huge numbers of people being engaged online, special interest groups are not able to skew the results. The same is not true of public meetings where a small and vocal minority are easily able to dominate the dialog. Special care must be taken to avoid this danger if public meeting are a part of your outreach.
More to come…