Digital Skills Observatory 2016 | Comprehensive Analysis

The Digital Skills Observatory is a 12 month participatory, action-oriented, research project studying the impact of digital skills training sessions on low income first-time smartphone users in Kenya.

We conducted regular interviews to measure the impact of this training and the progress participants made in using their first smartphone. This website analyses the data collected in all these interviews. Themed pages with charts and timelines show relevant differences between gender and  treatment and control groups on specific interview questions. They are accessible under the full analysis heading below.

Some of the highlights:

  • People who attended the workshops show a much higher completion rate of various technological evaluation tasks, on average. The training participants received had a measurable effect on their ability to deal with technology and smartphones.

  • The adoption of new social media accounts and app installations wanes over time for all participants. After an enthusiastic starting period participants start to look at what they really need and remove unwanted apps and accounts.

  • The use of digital financial services (DFS) doesn't seem to be impacted much by the training.



Treatment CONF1: I am confident that I can use my smartphone to its full potential

CONF1: I am confident that I can use my smart phone to its full potential
Count
Somewhat agree38
Strongly agree25
Neutral (neither agree nor disagree)16
Somewhat disagree4
Strongly disagree3


Learning

Throughout the interviews many questions were intended to gauge how the respondents learn digital skills, what they wanted to learn about technology and how confident they were with their own smartphone skills. This page presents a snapshot of findings on these topics.

Respondents from the treatment group participated in several intervention workshops. This subgroup of respondents were asked additional questions about what they learned and shared from these workshops.

During the fourth interview session in July 2016, respondents were asked a couple of questions measuring their confidence in handling their smartphone. They were asked to rate how much they agreed with a statement relating to smartphone use.

Overall, there were some notable differences between the answers of the treatment group and the control group, as well as between those of female and male respondents.

Control CONF1: I am confident that I can use my smartphone to its full potential


Lifestyle and Economy

This page deals with the question 'Has your income changed since the last visit?'.

Across the interviews, the respondents say that their income has changed between 15% and 26% of the time since the last visit. Interview 4 in August saw a dip across genders and the treatment group, but not for the control group.

Percentage of respondents that answered 'Yes' to "Has your income changed since the last visit?"


Have you opened a new social media account since our last visit?


Adoption of Smartphone, Internet and Apps

This page deals with the following questions, as answered across all interviews:

  • Have you opened a new Social media account, since last time we visited you?

  • What is the status of your phone?

  • Have you had to buy/receive a new phone, apart from the one you had last time?

  • How many apps do you have on you phone?

Have you had to buy/receive a new phone, apart from the one you had last time?


How many apps do you have on you phone?


Selection of 'Which digital financial services have you been using since the last visit?'


Digital Financial Services

This page deals with the following questions:

  • Which digital financial services have you been using since the last visit?

  • How often have you been using digital financial services since the last visit?

  • What is your total balance from DFS (excluding airtime)?

  • What would you like to learn about digital financial services since the last visit?

How often have you been using digital financial services since the last visit?


What would you like to learn about digital financial services since the last visit?


What is your total balance from DFS (excluding airtime)?


EV1. (Wi-Fi) My phone’s hotspot is turned on, and is called [your hotspot name here]. Show me how you can connect to it. (Treatment)


Evaluation

People who attended the workshops show a much higher completion rate of various technological evaluation tasks, on average. The interventions have a meassurable effect on the ability to deal with technology and smartphones.

For example, 71% of the people in the treatment group had no problems connecting to a Wifi hotspot. For the control group, this was only 44%.

EV1. (Wi-Fi) My phone’s hotspot is turned on, and is called [your hotspot name here]. Show me how you can connect to it. (Control)


TR3. Please rate which was your favourite: [Sterro, Jisort, or Workshops]


Treatment Group Retrospective

The treatment group answered questions about how they liked the workshops, and what they learned from them. The answers are varied, and very informative.

Notes from respondents who selected 'Sterro' for the question 'Which was your favourite intervention?'


Did you feel more comfortable learning throught Sterro than through the workshop?


Treatment group evaluation questions: Sterro

These questions deal specifically with Sterro, DSO's fictional digital oracle.

Do you have any messages you’d like us to give to Sterro now that he’s gone?