How to calculate with missing values in questfox

We are also adding functions to this world of math by creating our own formula for the market research world being able to create a sum or an average respecting the fact, that someone did not see or answer a question. Our operations for the so called “missing values” help you to analyze correctly long before you can do similiar things with sophisticated tools like SPSS. See our idea of how to treat missing values https://questfox.news/2021/03/08/missing-values-in-market-research-with-questfox/

When you then want to calculate with a variable that contains “missing values” you will face trouble in the analysis. questfox has two special functions to take that into account.

The syntax is described here

qf_avg()Returns the average value of the input values (seperated by comma) and excludes missing, not seen and not answered values.
qf_avg(@81c4af14-4857-49b8-9dd7-449b33e73e60@ , @7151c6d2-48af-4619-8318-39b62aa99b07@)
qf_sum()Returns the sum of the input values (seperated by comma) and excludes missing, not seen and not answered values.
qf_sum(@81c4af14-4857-49b8-9dd7-449b33e73e60@ , @7151c6d2-48af-4619-8318-39b62aa99b07@)
Calculations with missing values.
Live Calculation in questfox

We suggest to ad an invisible number inside the questionpage and calculate right into that hidden variable. You can later use this value as a trigger for questlogix or to show this value live to the respondent.


Missing values in market research with questfox

The phenomenon is not recent. People do not answer to questions. If someone does not answer to a question we are talking about so called missing values.

Also see the Wikipedia article: https://en.wikipedia.org/wiki/Missing_data

questfox knows 3 different kinds of missing values.

Missing value -99

someone clicked explicitly on “no answer”

Missing value -77

the question was not even shown to the repsondent (due to skipping/hiding procedures)

Missing value -88

classic missing value meaning the question was shown, but the answer was not mandatory so the respondent could click through

A good idea is to make someone click on each question, but this means that you will have to add the option “no answer / do not want to tell” to every answer where you require a mandatory click. Even if you do some of the questions or items will not be shown and therefore create a Missing value (-77).

Why is it negative with two digits in questfox?
The answer is pretty simple. If you use a scale from 1 to 5 and your default missing value is 9 (as some of us learned in their statistics class), you may not realize that you have an issue with missing values in your report. In the questfox default you would easily see that something is wrong in your definition of missing values.

These three default values are assigned to every question type and can be changed under “Define Missing Values” in the edit answer section.

3 types of missing values in online research

When using SPSS these values can be defined as discrete missing values.

Discrete missing values in SPSS

Now it is up to you if you can force your population into answering all the questions.


questfox maintenance 1st of March 2021

The world is turning faster than ever. In order to cope with this we have to work on our servers as of today the 1st of march 2021.

The servers are still available but some data intensive services like export or analysis may make you wait longer than normally.

Sorry, for any inconvenience but you will feel a more powerful version of questfox after the maintenance procedures.


Handling of internal and external IDs for re-direct links

The questfox system is a little picky in terms of letting other tools know about internal IDs. But here is the description of a work around if you need to use the internal or the external ID.

Internal response ID

Internal questfox ID: The internal ID is a unique ID that is generated for every participant.

It looks similar to this:
ff211178-8f79-40ec-8ffa-bce6914ec5fa

If you export the data you will find that internal ID in the first row of the data set.

Example of IDs in questfox

Now here is the trick how to use that ID inside your questionnaire and for re-direct links.

  1. Create a new TEXT question
  2. Hide this new TEXT question from being shown in the questionnaire
  3. Create a questlogix with calculation
  • Trigger: At the beginning of the survey
    Calculation (pick the target variable, in which you want to overwrite the internal ID.
Example of copying internal and external ID
  • Just type into Calculation Formula:

qf_RespondentsID

Using Calculation to copy the value from the internal system into the questionnaire

This procedure will right at the start of the survey write the internal ID into that new variable that is accessible to you. You now have access to that field as if it was a regular question. For example you can transfer this value into a panel tool by adding the new variable code to a link.

The code can be found on top of each variable.

Example of a response ID / question ID in questfox

Add your variable to the link in brackets like {yourVAR}

Panel.TLD/questXYZ&InternalID={d3239cec-2a9e-435d-9b46-dd8ead10a870}

External Response ID

External IDs are pretty common in the interaction with people. You may find them as Panel ID; Customer ID; Student ID etc. In normal studies startet from questfox you may not even use an external ID. It is possible to upload addresses into questfox using this external ID. In case you are in interaction with an inviting panel company they will definitively send an ID over to questfox to be treated as an external ID. Normally this value does not leave the survey system. But sometimes you may want to re-direct into other tools and back and may need that ID.
The procedures is identical to the one described above for internal IDs. The only thing you need to remember is that the internal description of any kind of external ID in questfox is called:

qf_ExternalID

Again you may want to create a hidden TEXT Variable and overwrite its value at the start of the survey with qf_ExternalID.

Using Calculation to copy the value from the internal system into the questionnaire

And after that procedure you can use that ID as often as you want.

VariableName of the variable
Internal ID for each questionnaireqf_RespondentsID
External ID (only in connection with other partner)qf_ExternalID


Device Agnostic Implicit Measurement with #questfox #system1 # implicit #seriousfun

Happy to announce a break-through in the development of a brand-new question type inspired by the ideas of Daniel Kahnemann and Amos Tversky.

The question type Implisort is meant to cover the system 1 environment of fast and instinctive decision making.

We are very proud to be the developer of the first worldwide implicit measurement tool that works on all kinds of devices without necessary technical adaption. The question type is functional with multiple interaction tools like mouse, defined keyboard keys or even touch screens. This also includes mobile smartphones.

The continous development of our TinSort idea is now measuring the time a respondent needs to answer to a specific stimulous. Series of simuli can be exposed in random sequencens to be answered and measured in reaction time.

The new question type ImpliSort is avaiable exlusively in questfox. It can be combined with any other question type and therefore be analyzed in totally different szenarios.

The flexibility of questfox allows to transfer data and even react on data given by the respondents (Ex. Someone slower than average is re-directed to other questions).

We are entering a new field of research allowing questfox users to develop their own approaches of implicit measurement. We are just the technical provider of an idea which will grow with the usage of more savvy people in the world of psychology. Looking forward to see your ideas grow with our tool.

We have to admit that we are still running a series of questions testing the effects of different interactions modes and their results in numbers. We will be able to deliver a lot of new ideas based on that initial idea of analyzing decision making in system 1.

By the way: We still offer a complex world of system 2 questions in the Analytic Hierarchy Process environment. With our recent developments both worlds can be better understood in the future. A combination of this idea with other questionnaire approaches helps to develop new research ideas.


WaveNet Text-to-Speech integrated into questfox

Reading out loud the research question

For years we have been using different tools to create synthesized speech from text. In 2017 these features were implemented in questfox in times when it was even a little too early for that technology. Our speakers sounded a little too artificial to the human hear.

With the last update we are now able to deliver more human sound in the reading out loud functions of questfox by integrating WaveNet right into questfox.

WaveNet

This is what Google tells about the WaveNet Development.
“Google Cloud Text-to-Speech enables developers to synthesize natural-sounding speech with 100+ voices, available in multiple languages and variants. It applies DeepMind’s groundbreaking research in WaveNet and Google’s powerful neural networks to deliver the highest fidelity possible. As an easy-to-use API, you can create lifelike interactions with your users, across many applications and devices.”
Source: https://cloud.google.com/text-to-speech/

TTS in questfox Multimedia Insights

You will find the function right under Multimedia Insights – Text to Speech

At the moment we offer 5 languages for the text-to-speech functionalities inside of questfox. The default language is English (US).

5 languages already available in questfox

WaveNet was first supporting English and only integrated German lately. It may take some time before other languages may be available. We will keep you updated on the issue.

Select the voice of your choice

Listening while reading?!?

We are still in consideration whether participants should listen and read at the same time. Some of our own people argue that we should force interviewees to listen only. If you plan to do this you can set the visibility of the text to hidden by integrating the following into CSS.

Click on View – Source Code to open the HTML Window of the editor.

Put the following command in front of your text

<p style=”visibility: hidden;”>Your text here</p>

And you will no longer see the written words.

Please only do so once your text is finalized because you will not even see the text anymore in the editor 🙂

Future of speaking software

Looking at the speed of development we are pretty confident, that these functions will become better and better. It’s not bad already. But are you and your respondents already ready for this?

An interesting project in South Africa showed us the potential of this approach with people who are listening to the read out loud questionnaire.


#questfox feature alert: Client’s SFTP Server integration for audio files

We are very proud of the questfox development in speech. It is possible to record someones voice and to transcribe what the person said into text.
With more than 120 languages integrated, we are perhaps the leading tool for this kind of feature in market research.
As more and more users were saving thousands of answers on our servers we constantly discussed this feature set for security and performance reasons.

Saving Audio Files outside of questfox

The idea of questfox speech tools is to receive the content said as a transcribed text. On top of this procedure questfox allows to save the recorded voices. The default setting for recording audio is OFF. So you need to switch ON this feature if you want to use it and later listen to the audio files.

To record the audio files you can switch the answer settings of an audio question type to ON.

The multimedia files used to be saved independently from the answers on the questfox server in a special folder structure.
In this setting we could not prevent that project admins of a project space could listen to the audios of other projects in the same project space.
In projects with thousands of audio files we had to admit, that performance of data handling in gigabytes became an issue in the browser. With the new approach this is over. You can decide where to save your data and you will have much quicker access as you can use your established tools to work with these multimedia files.

Security by Design with SFTP

Multimedia Files are now saved on the client’s side via SFTP
We now changed this forever and fulfill an important demand of our clients who always ask: Where is the data stored? From now on the answer will always be the same: The multimedia files are saved in your own security environment and not be in connection with the rest of the survey.
The recorded answer can be saved in your own environment and therefore out of everyone’s reach, using questfox. This is a major improvement in the field of data security as the multimedia data is now stored on the client’s side.

Important Notice: Make sure, that you have a user’s allowance to record his or her voice or video before saving this very personal information somewhere on the internet. This was a requirement before this new technology was implemented and still needs to be respected.
questfox is not responsible for your behavior and not reliable for your actions with our software. So please take data protection issues serious – especially in this very delicate field.

How to integrate your SFTP Server into questfox

Under CREATE – Projects Settings you will find a place to integrate your SFTP Settings.

SFTP Settings und CREATE – Project Settings

Your password will never show-up in questfox and cannot be copied from the data input file.

Organize your data following your needs

The data can be organized by three different settings: Question, Calendar Week or Participant. We advise you to do this only once per project to avoid confusion in the data structure.

Default is the organisation by question. Saving a single file would create a folder called “questfox” on your SFTP Server with a subfolder carrying the project ID and more subfolders named Q1 .. Qn with your multimedia data.

Folder Structure of SFTP Server after recording voice in questfox

If you wish to organize the folder structure differently you can switch to “Order by Calender Week” and see the result later as “44-2020” which is the 44th week of the year 2020.

Folder Structure if ordered by Calendar Week

If you plan to look at the answers of one person you can organize the folder structure by “Participant”. questfox would create one folder for each individual and ad the answers to one question in this folder organized by question number (here Q1 and Q2).

Folder Structure by participant

And by the way: We updated to the most recent versions of transcription services. So the overall quality should become always better.

We wish you all the best with this new security feature which gives you the full power to manage sensitive data on your side. The flexibility of this approach will be important for complex projects.

FLAC – Free Lossless Audio Codec

In order to be independent from any kind of manufacturer we opted for the FLAC Codec to save in perfect nearly lossless quality.

For understanding this codec better we recommend this link https://en.wikipedia.org/wiki/FLAC

In case your Audio-Tool is not able to play this data we recommend the VNC Player which can be used entirely free of charge. Download available here: https://en.vlc.de/


How to motivate survey participants from the start?

Every questionnaire is too long

It is a sad truth that every questionnaire is too long. But the reason why respondents drop-out are more related to the first minute of interaction than to the actual duration of your questionnaire. On average more than 50% of the people clicking on your survey link drop out on the INTRO Page. They run away as you are trying to say hello. So please take some extra care when designing this page.

INTRO Page is the most important page in a survey.

The INTRO-Page is by definition the most important page of your questionnaire. Here people are coming in after an e-mail invitation or a link on social media not exactly knowing what to expect from the survey (sometimes even not knowing that it happens to be a survey).

So please make sure, that these first seconds of the contact with an unknown third party are a pleasant experience. Try to integrate some interesting things and try to avoid boring necessities like legal texts (if your institution does allow you to link=hide that somewhere else)

Killers of Motivation

  • Standard text is not a motivator
  • The detailed descriptions of your problem is not helping others
  • Your internal issues are not motivating
  • Legal hints are not motivating
  • The need to scroll is a killer on a desktop and even worse on a smartphone resulting in drop-out rates. If one can’t see the start button chances are high to lose that person even before the start.
  • Big pictures need to be downloaded by the participants and will create drop-outs when they come in slow over slow internet connections.

Suggestions for motivating INTRO pages

  • try to be interesting
  • Move things
  • Do not use too much content in this phase
  • FOMO: Create the fear of missing out

Example of the questbox Intro

How to create a motivating INTRO Page in questfox?

INTRO Page in every questfox project

Manipulating the Intro page is questfox is easy as the Intro page receives it design from the question page Q1. Whatever you design in Q1 becomes the design of the intro. Here is the trick if you want to use a specific design for the intro:

Add an empty question page and move it to the position as Q1

Add an empty page to your project
Change the order to make your empty page Q1
Enter Q1 and change your design under “Page Style”

Example of an intro page with positive effects on participation

The following example is pretty easy to set up following those instructions.

Animated Intro Page inside of questfox
  • Upload animated GIF in the middle of a white INTRO Text
Animated GIF uploaded into the intro text editor
  • Big Photo uploaded in the background of the outer frame under Project Style
Outer Frame Picture upload in questfox
  • Set color of the inner frame to black and Opacity to 0,6
Set color to black and Opacity to 60%

Hope this helps you think about the motivating intro. Looking forward to see you create marvelous intros.

More inspiration on animated content under https://giphy.com/kochstrasse

Tap Here GIF by Kochstrasse™
https://giphy.com/kochstrassehttps://giphy.com/kochstrasse

The real voice: feature alert organizable folder structure for audio and video recordings

More and more of our customers are discovering the beauty of Voice or Video answering in research interviews.

The quality of the transcriptions is getting better day by day, but a lot of our users still like to record the audio file as a backup for the transcription (user’s conscent is always required).

With the growing number of recordings, the organisation of these files becomes difficult. Some project owners would like to save the files week by week. Some would like to organize the content by question number and just recently some users wanted to save these files organized in a separated folder for each participant separately.

From now on it is possible to define the way your audio/video files are stored.

Under Project Settings you can select

Organize audio/video file upload by…

Default is organisation by QUESTION

This setting right away changes the way multimedia recordings are saved in your project. You will still find those files in the folder survey_uploads in the FileManager.

A glance at our future development. In order to save data and to make it more secure we will allow to user your own SFTP server for these uploads. Please allow us some weeks before we can officially publish this security update.

Update November 2020: The SFTP Connection to your own server is ready to be used. More details under:

https://questfox.wordpress.com/2020/11/01/clients-sftp-server-integration-for-audio-files


questfox Special Vocabulary Training for Speech2Text with new OOV feature

OOV – Out of vocabulary – questfox is sometimes leaving us speechless.

Week by week we see incredible advances in the development of our speech-to-text approach inside of questfox. One of the everlasting challenges is the wrong transcription of words which are not correctly understood in a specific context. 

If something is misspelled by a computer this normally happens when the word used is outside the standard vocabulary of the application. This tends to happen often when words are used in a company specific context. By the way this seems to be true for every single market research project.

When asking about a brand some may be asking for competitors with a very special name and a very special spelling. In these cases the transcription technology tends to fail to recognize those specific names. Technically speaking the words used are “out of vocabulary” (OOV). 

The questfox solution to the OOV problem: It is now possible to create a list of special words to be integrated in questfox. Everytime the transcription engine of questfox is used this list is sent to the transcription engine to have a better understanding of specific vocabulary used.

Here is our questfox experiment to test the tool with some less common brands

BrandTranscription without OOV ListTranscription with OOV List
questfoxquestfox questfox 
pangea labsPangea Labspangea LabsPangea Labs
questlogixauslogics 
Quest Logixx
Quest logics
questlogix 
Wisdom of Krautswisdom of crowdswisdom of crowds
Tjaereborg ReisenSherlock Reisen
Djerba Reisen
sherbrooke reisen
Djerba Kreisen
Tjaereborg Reisen
L’OréalLorealL’Oréal 
Comme des Garçonskomm DKVkomm digga Songcomme de garcon Gasthaus.com Digger
kommen die ganzen

As you can see the overall transcription results do improve. But some issues remain.

Those who use mixed spoken language inside one dictation process may be familiar with the fact that transcription only works for one language at a time and hardly ever for two languages simultaneously.

As questfox works with an “expected language” tag for the transcription everything which is far away from the expected language is difficult to understand by the tool. In our pretest language German it was not possible to capture the french brand “Comme des Garçons”. We also failed with our made up brand “Wisdom of Krauts” which is still not transcripted in the desired way. The correct spelling seems to dominate the process and we get the undesired transcription result even after putting it into the list of special words. 😦

The only questfox way to “correct” this spelling would be the use of Regular Expressions in the questlogix. By the way: questlogix is such a distinct word with no similarity in the dictionary that our integration in the list of special words did function right away. Here is how to use RegEx in questfox:

https://questfox.wordpress.com/2018/04/04/text2click-regular-expressions-available-in-questfox-questlogix/

Even while still in development we hope that you appreciate the publication of this feature and share your experience with us.

At first we defined the usage based on each questfox project as we believe that every specific project might have the same vocabulary issues inside one project. You can define your individual “Bag of Words” in the projects settings

The syntax is separate each word by comma. If you have several words just use them in a row
Word, word, word, combination of words, 

Our typical list would be
questfox, pangea labs, questlogix, what’s your quest?, Speech2Text

In questfox you can paste one list of words per project under

->Project Settings 
-> Special List of Words for Transcription / Out of Vocabulary (OOV)

Please share your gained knowledge about this feature.