Social Integration Measurement Toolkit Feb 2021
Social Integration Measurement Toolkit Feb 2021
Social Integration Measurement Toolkit Feb 2021
I NT E G R AT IO N
M E ASU R E M E N T
TO OL K IT
Researched and written by PRD, We Made That and UCL Institute for Global
Prosperity. Design by Maddison Graphic. Commissioned by the Greater London
Authority.
7 Background
16 Part A
Defining social integration
24 Part B
Guidance on social integration
measurement
27 Stage 1: Plan
36 Stage 2: Collect
47 Stage 3: Reflect
W HAT IS
T HE SO C IAL
I NT E G R AT IO N
M E ASU R E M E N T
TO OL K IT ?
People shopping at a market in Lewisham. Credit: Luca Marino
Social Integration Measurement Toolkit 6
BAC KG ROUND
‘The extent to which people positively interact and connect with others
who are different to themselves. It is determined by the level of equality
between people, the nature of their relationships, and their degree of
participation in the communities in which they live.’
The creation of an improved social evidence base has a key role to play in
supporting this approach, and is one of the four core components of ‘All of Us’,
the Mayor of London’s Social Integration Strategy.
It will help to track the specific impact of policies and projects, improving
strategic planning, and supporting the development of better initiatives to
support Londoners. It will also enable the Mayor to advocate for policy change
by central government and other decision makers.
This is about more than just measuring success; it is about helping Londoners to
become aware of how social integration affects our wellbeing and prosperity. It
puts into context the powerful contribution that all Londoners make to the success
of our city. It reveals the extent to which we are all able to share in that success.
The toolkit provides practical advice to support the collection of broader and
deeper information on social integration in a range of different contexts across
London.
2. Understand local areas and communities, how they are changing, and
how change is impacting on social integration
The toolkit should not be used in isolation. It should be used alongside the
suite of GLA documents on impact and measurement – including the Good
Growth Impact and Evaluation Handbook.
Social integration is relevant to all aspects of London life – from the built
environment, infrastructure and urban regeneration, to business and
enterprise, employment and skills, culture and leisure, health and wellbeing,
and community development. In a recession and recovering city, it becomes
even more important to approach this in a systematic way.
The Mayor is just one of several actors who will shape the future of social
integration in London and will need the support of partners to achieve his
vision. In this way, the toolkit is targeted at a broad range of organisations –
from the largest public sector institutions to small civil society organisations.
These include:
More so than ever, there is a need for all types of organisations across London
to have a better understanding of the factors that influence social integration.
By exploring this collectively we stand a better chance of making progress and
ultimately sharing in the benefits of a fairer and more equitable city.
Better information and evidence creates insight and empathy, which in turn
can support better projects. The research you carry out will help tailor the
approaches your organisation takes, identify important lessons, and support the
case for future action. And, it will contribute to a shared knowledge base that will
benefit all Londoners. This toolkit can help you and your organisation to:
1. Why? Research
Purpose Understanding Understanding Understanding
Reasons for the experiences Places and their the impact
undertaking of Londoners Communities of Action
research into
social integration
2. What?
Built
Research Focus Economy & Employment
Area of potential environment &
Enterprise & Skills
Infrastructure
thematic focus
/ interest in
undertaking
social integration Culture & Health & Community
research Leisure Wellbeing Development
3. Who? Potential
Mayoral family Education & Charities &
Users
& Boroughs healthcare community
Types of organ-
providers groups
isations which Example focus: Local
understanding impact
have an interest of intervention, city
Example focus: Com-
munity characteristics
Example focus: Local
concerns and issues;
in understanding governance
and needs representation
social integration
and undertaking
research Development Business & Cultural groups
industry business groups & institutions
Example focus: Example focus: Business Example focus:
Tailoring delivery and responsibility and social Relevance, reach and
understanding impact impact impact
Trusts &
Foundations
Example focus: Local and
thematic representation:
local impact
The publication of this toolkit aims to provide the starting point for an ongoing
conversation which brings together partners across London, linked by a
common commitment to evidencing and influencing social integration.
WH AT THE GL A WIL L DO
As well as providing consistent questions, oversight and advice via this toolkit,
the GLA is also committed to being a conduit for the collection, aggregation
and analysis of data on social integration.
Through the City Intelligence Unit and Social Integration Teams, the GLA will
work to develop an appropriate repository for partner information so that
evidence can aid ongoing reflection on how current and future projects can
adapt to make the city more inclusive and equitable.
There are multiple ways in which partners across London can collaborate in
the delivery of the Mayor’s Social Integration Strategy.
These include:
• Share data / information on social integration with the GLA and with other
partners across the city
• Look out for opportunities launched in City Hall’s new civil society
engagement programme
• Host the Mayor or Deputy Mayor on their borough visits to share examples
of best practice in each borough
PART A
D E F I N I NG SOCIA L INT E GR AT I ON
How social integration is defined and an overview of the specific measures
which can be used to help understand it.
PART B
G U I DA N CE ON SOCIA L INT E GR ATION ME ASUREMEN T
Practical guidance on the social integration measurement process, from initial
planning through to communicating findings.
PART C
TO O LS TO SU PPORT SOCIA L IN TEGR ATION ME ASUREMEN T
Eleven practical tools which have been developed to support the measurement
process: from designing research questions, to choosing research measures,
to writing surveys and reports.
PART D
P R ACTI CAL E X A M PLE S OF SOCIAL IN TEGR ATION ME ASUREMEN T
Case studies of some of ways which different organisations across the UK
are prioritising social integration measurement, and some of the practical
approaches which are being applied.
D E F IN IN G
SO C IAL
I NT E G R AT IO N
Koolkidz Nursery. Credit: Caroline Teo
Social Integration Measurement Toolkit 17
ALL O F U S : D E FI NI N G SO CI AL
IN T E G R ATI ON
Even before the challenges and reflection created by COVID-19 and Black
Lives Matter, Sadiq Khan had stated that “communities have been changing
rapidly, inequality has increased and our sense of social cohesion is being put
to the test like never before.” It was this acknowledgement that led, for the first
time, to the creation of a Social Integration Strategy for London.
The Social Integration Strategy has three key themes that relate to life in
London: Relationships, Equality and Participation. A fourth theme of the
Strategy is the creation of a stronger evidence base, of which this toolkit is a
fundamental part.
The Strategy sets out how the Mayor and City Hall will work with others to
help improve social integration in London. It recognises that the Mayor cannot
change social integration on his own. The Strategy challenges others to play
their part, with the promise of support to help them do this.
EQUALIT Y
RE L ATIONSHIPS PARTICIPATION
Enable Londoners to build Reduce inequalities which could Reduce inequalities which
stronger social networks in otherwise undermine social improve volunteering and social
early years and family support integration, working alongside action opportunities to increase
settings, so that more of partners to achieve this, participation, particularly among
London’s families benefit from particularly in the areas of skills, groups of Londoners who
social integration housing, planning, regeneration are currently less likely to be
and policing engaged
Support London’s councils,
central government and other Work with employers and Equip more Londoners to
partners to embed principles businesses to help improve participate in democratic
of social integration into their access to employment and processes such as voting, public
institutions increase opportunities for debates and citizen-led action
social integration in London’s knowing how to engage and that
Develop world-leading best workplaces their voice matters
practice on using sport,
volunteering, arts and culture Address specific barriers to Ensure that City Hall works
as powerful tools for social social integration through with Londoners in developing
integration targeted programmes such and delivering its policies, and
as promoting pathways to encourages other institutions
Establish London’s reputation as citizenship, improving English to adopt a similar citizen-led
a welcoming city for newcomers language training and widening approach
from other parts of the UK and digital inclusion
abroad. Newcomers must have
opportunities to feel a strong Lobby for changes to central
connection and positive sense government policies which
of belonging to the city in which currently present barriers
they are living to social integration, for
example the implementation of
immigration policies
The measures have been selected from existing datasets, such as large-scale
central government surveys, council surveys and local administrative data.
The measures have been selected because they are widely-used, which
means:
• In many cases, data / evidence about social integration can be collated from
existing datasets
• The measures are widely tested so are robust and will be relevant over time.
The measures are summarised in Figure 3, with further information and detail
available at the following link: https://data.london.gov.uk/dataset/social-
integration-headline-measures
EQUALIT Y
OUTCOMES
RE L ATIONSHIPS PARTICIPATION
Measurement Themes:
The findings highlight some of the social integration challenges and barriers
which currently exist across London, including high levels of inequality,
employment rate gaps, a shortage of affordable housing, challenges accessing
support to learn English, and legal rights to citizenship and residency.
This early evidence provides a useful starting point for the city as a whole.
All over London however, boroughs, civil society organisations, town centre
managers, developers, facilities managers, sports organisations and park
authorities are carrying our research that can contribute to a deeper and more
localised understanding.
Uniting these many diverse approaches is one of the key functions of this toolkit.
EQUALIT Y
OUTCOMES
RE L ATIONSHIPS PARTICIPATION
Measurement Themes:
92% of Londoners agree The employment rate for BAME Two thirds of Londoners have
that people from different Londoners is 20% lower than participated in leisure activities
backgrounds get on together their White British peers in the past month
locally
Over a third of Londoners 28% of Londoners regularly
More than a quarter of have been unfairly treated in volunteer formally but
Londoners feel they have no one the past year because of their volunteering amongst 25-34
close to rely on characteristics or class year olds is half the rate it is for
55-64 year olds
45% of Londoners borrow and 46% of Londoners have savings
exchange favours with their of less than £1,500 86% of Londoners are registered
neighbours to vote
7% of Londoners report that
9% of Londoners have frequent their language is not very good
positive contact with people when they need to speak English
from a different social class OUTC OMES
GUI DA N C E O N
SO C IAL
I NT E G R AT IO N
M E ASU R E M E N T
T HE M E ASURE M E NT
P RO CE S S
Broadly speaking, all good evidence collection encompasses three main
research stages: planning, collection, and reflection.
While the specific approach to measurement will vary from one project to the
next, following these three stages, and the nine steps identified within these,
will help you to tailor the research to your local context, ensure the collection
of information that responds directly to your needs, and to do so in a way
which is robust and replicable.
1.3 PL A N A PPROACH
2.3 A NA LYSIS
3.3 L E A RN A ND A DA PT
The planning stage should comprise three key steps: initial work to define the
purpose of the research; scoping of the measures and indicators to be used;
and finalisation of research approaches.
This research process is summarised below. Six tools have been developed to
help you plan your research; these are provided in Part C of this toolkit, with
links provided below.
See
TO O L 5 . D E CI D I N G O N YOU R RE SE A RC H A PPROACH
(Q UAN T I TAT I VE AN D Q UALITATIV E )
The key first step in any research process is to establish a clear idea of what it
is you want to understand, and why.
In some cases, social integration may form the sole area of interest or focus
for your research. In other cases, however, social integration may only be
one aspect within a wider set of research interests: be it economic, social or
environmental considerations.
Either way, aim to map out clearly the relationship between social integration
and the context of your project, place or organisation. One, two or all three
of the Mayor’s social integration domains (relationships, equality and
participation) may be relevant.
In considering the purpose of your research, you should consider whether you
are looking for quantitative or qualitative insights, or a mixture of both. The
difference between the two is summarised in Figure 6. In simple terms:
Quantitative Qualitative
Deals with numbers and statistics Deals with words and meanings
Once you have established a clear research objective, and set of research
questions, aim to test these with relevant partners. Securing wider buy-in from
the outset can be influential in securing support and input as the research
process progresses.
However, in many cases, and particularly at the most local scales, primary
research will be needed to supplement existing information, to fill gaps and to
create new insight.
There is no set guidance for how many measures you should select for your
research. While encouraging a balanced set of measures across the three
domains, even if you can only collect information against one measure,
this will still provide valuable insight to feed into the local and London-wide
understanding of social integration.
Once you have a clear research purpose and questions, and an agreed set of
measures, you will be ready to scope and plan the research in more granular
detail.
This is where you will need to consider the technical details of how you are
going to collect information and your resources for doing so.
More broadly, development of a simple research strategy or plan will help you
to establish and set out the methodology in a structured way; a template for
this is provided in Tool 6.
• Study area: Are there any geographic parameters for your research?
• Local context: Are there any key local groups / individuals who could
play a role in shaping or delivering your research?
• Timeframe & timescales: Is your research longitudinal or one off?
What is the overall research timeframe? How frequently will you
return?
• Types of information: What will be the balance between quantitative
and qualitative information? Will you need to undertake primary
research?
• Primary research approach: If undertaking primary research, what
type of research will it be? How many people do you need to speak to?
Who will it be undertaken by and when?
• Resource: What are the costs involved in the research?
• Analysis: How will you collate and use the data when collected?
Study area For pieces of research which are place based, it is important to
Are there any establish a clear definition of the geography that you are focusing on.
geographic This may be a formal administrative area (e.g. a Borough, or a ward),
parameters for a local community (which is likely to need bespoke definition), or a
your research? catchment area (e.g. the area from which project beneficiaries are
drawn from). The size of the geography will have direct implications
on the number of people you will need to engage and hence the
resource implications of the research. Once selected, it is ideal to keep
geographies consistent throughout the research – particularly where
this is being undertaken across multiple points in time.
Local Context An initial mapping of the local / project context will help you to
What groups / understand the population that you will need to engage. This might
people will you include review of government statistics providing intelligence on the
approach? local population, working with local partners to access any locally-
held intelligence, or (in the case of projects) interrogating your own
intelligence.
Further information on key sources of secondary intelligence is
provided within Tool 7.
Types of At an early point you will need to decide on the types of information
Information that you want to collect and your approach to doing so. The balance
and Approach between quantitative and qualitative insights is an important element
of this, as is the need for (and extent of) primary research. Ultimately
these decisions will be informed by your specific research purpose
and questions. Tool 5 provides a checklist of considerations to support
with this process.
Resource In tandem with all the consideration above, it will be important from
What are the an early point to consider the costs of the research and how these
costs involved will be covered. These will relate both to the staffing needed to plan,
in the research? manage and analyse the research, and any additional costs relating
to undertaking survey work and communications. Where research is
longitudinal, a resource plan should be developed to cover the whole
research period, recognising possible changes in access to resource
over time.
Analysis How Initial consideration of how you are going to collate and analyse your
will you collate intelligence once collected, and how the findings will be reported and
and use the data communicated. This is explored in more detail in the next section.
when collected?
There are three key steps to the data collection process: work to collate
secondary information, primary research (where relevant), and information
analysis. The extent to which you focus on one, two or all three of these steps,
will depend on your specific research context and purpose.
Two tools have been developed to help you undertake your research; these are
provided in Part C of this toolkit, with links provided below.
See
In either case, research should include a review of all materials that you already
have, including:
An initial review of available data and information should have formed part of
your research planning process – including, where relevant, discussion with
key partners about the availability of any bespoke data which can be drawn
down or shared.
At this point in time all relevant data should be collated centrally to allow
interrogation and analysis.
In doing so, key consideration will need to include the geographic coverage
of the data, how up to date it is, how frequently it will be updated in the future
(in cases where you are tracking change), and the availability of information
for comparator areas to allow you to benchmark performance (this might be
similar local areas, your Borough, and / or London as a whole).
Make sure that you keep a clear record of your baseline research, clearly
documenting the information which has been collated, the time period / point
in time that it relates to, and any supporting notes or definitions needed to
support with potential future scrutiny / revisits.
Information on data sources which can help you with social integration
measurement is included within the Tools section of this Toolkit.
For this reason, the identified measures do not specify targets or timeframes
for when particular outcomes should be achieved and any target setting needs
to be considered very carefully.
That said, the measures are particularly valuable when used to measure
change and can be used to establish bespoke goals for your organisation or
project.
In these instances, you will need to think clearly about your theory of change
(please refer back to Tool 1): how your project or intervention is designed to
reach specific goals, and hence the outcome indicators which will be most
relevant in allowing you to track progress or performance.
Over time, progress against the goals can be measured and causal
relationships to be rethought where they are no longer supported by the
evidence.
Using the indicators in this way firstly requires the collection of baseline data
against which to measure changes. Further measurements should then be
taken at suitable points to capture changes.
As noted previously, there are several different options for how primary
research is undertaken. These include:
Street / locational More efficient than door to door, but harder to reach
surveys a representative sample.
Generally speaking, given the complex and often sensitive nature of social
integration topics, face to face research techniques are typically the best
option.
In instances where you are undertaking quantitative primary research, you will
need to continually refer back to your sample targets. In some cases you may
need to adjust your approach to respond to emerging gaps in the types and
numbers of people that you are engaging.
In other instances, however, there will be a need for larger scale field
work activity, and in these instances, you will need to consider how this
work will be resourced.
Structured surveys are likely to form a key part of your approach to capturing
quantitative information on social integration. The questionnaires that you
design will play an important role in determining the success of your primary
research.
• Introducing the research: think carefully about what you can say or write
upfront to make sure people can follow and understand the survey. The way
you introduce the survey will play a key role in making respondents feel
comfortable and well informed
• Audience and Language: Once you’ve worked out what questions you
want to ask, think about how you want to phrase them. You could try more
creative ways to present them for different groups. Some people may need
help with some words – for example, if English isn’t their first language or if
some words mean different things for them. You don’t always need to use
social integration ‘language’ to communicate with your participants, even if
this is how you will be thinking about or reporting the findings yourself
• Longitudinal research: questionnaires offer the advantage that they can
be repeated at different times to show trends and patterns in results. Take
this into account in designing your survey, asking questions in a format,
language and tone which have future repetition in mind
• Answer scales: think carefully about the best scales to use within your
questions. For example, is a number scale the best option for your
audience? While commonly used, some people may be unfamiliar or
struggle with using numbers to explain how they feel. You can teach them
how; but you need to do that before you ask the questions, and it could be
time-consuming and complicated
• Bringing in other measures: in many cases, social integration may only
form part of your survey. You will need to think carefully about what other
information you want to collect to help design a balanced survey. This
may include wider socio-demographic information which allows you to
explore, for example, how social integration varies among your target group
according to gender, age, ethnicity, working status, post code etc. You will
need to think about what you want to know and how you will analyse your
data, and ask the relevant additional questions
• Allowing for comparison: benchmarking of performance can play an
important role in helping to analyse and interpret findings, helping you to
understand the difference between your study area / object wider areas.
Take time to design questions to be consistent with existing available data
/ surveys so findings can be compared reliably to national / regional / other
local figures.
These include:
• research interviews
• discussion groups and focus groups
• community consultation events
• research diaries (where people write down their feelings, behaviours and
activities over a set timeframe).
Depending on when they are scheduled within your research process, they can
play an important role in helping you to access new audiences and, potentially,
survey participants.
They can also help add much greater depth to your research process. Most
of these wider methods provide information in the form of words (qualitative
data) which can be used alongside questionnaire data to help explore findings
in more detail.
2 . 2 . 5 Standards of Evidence
In the case of social integration, they can provide the basis for understanding
change over time (where relevant), but also for understanding how partners
can make the most difference.
Nesta and the Alliance for Useful Evidence have identified five levels of
evidence which enable those seeking to measure their impact to assess the
strength of the data they collect.
It is important to note that these (and other) standards of evidence are not
a test. In some cases (particularly where projects are small) it is perfectly
reasonable to operate at level one, taking time to reflect and make
observational judgments.
Level 3 Level 2
You can demonstrate causality You capture data that shows
using a control or comparison positive change, but you cannot
group confirm you caused this
Level 4 Level 5
You have one + independent You have manuals, systems and
replication evaluations that procedures to ensure consistent
confirms the conclusions replication and positive impact
The analysis step will allow you to make judgements on the breadth and
coverage of the research, the quality of the information, and the insights that it
provides.
• Data coverage and quality: how strong is the coverage of the data you have
collected against the selected measures. Are there certain measures where
the data collected is not complete or reliable enough to report on?
Ensure you have a robust plan in place for how you manage and store the
information, who has access to it, and how you use and report on it. This must
align fully with the wording used on your questionnaires and engagement
tools regarding the use of personal data and information.
Again, please refer to the Further Reading section of this toolkit for more
information on matters of data confidentiality and security.
Having collected and analysed your information, you should be able to return
to the purpose that you identified at the outset, and report back to your
partners with clarity and honesty.
Three tools have been developed to help you report on your research; these
are provided in Part C of this toolkit, with links provided below.
See
As noted previously, social integration is a complex area, and it is likely that the
information you have gathered will be multi-layered and multifaceted.
Returning to the research questions that you posed at the outset provides a
clear framework via which to draw these conclusions.
• Are the results surprising in any way? Do they show you what you expected
to see? Did you expect results to be different? If there weren’t surprises,
what did you know in advance that allowed you to be accurate in expecting
what the analysis would show?
• Can you see patterns within the overall results? Did some questions
produce answers which were not in line with the others? Why? Did some
types or groups of people answer questions very differently than other
types or groups? Why?
• Where relevant, how did results change over time? Why do you think this is
the case? Did they change for some people and not others?
• How does your sample compare with wider averages (where information for
comparators is available)? If there are differences, how significant are these
and what might explain them?
While it is important to draw conclusions, always bear in mind the size of your
sample and the reliability of the data; where there is uncertainty or lack of
clarity, be honest about this.
Measuring social integration is of greater benefit if you share the results with
your audiences. In this way, the research will provide value far beyond the
direct needs and purpose of your organisations.
Begin by considering the audiences you would like to share your findings with.
The list will vary from one context to the next, but may include: local residents,
service users, community and voluntary groups, local statutory organisations,
funding bodies.
How you share your findings will depend on your specific context, but options
could include:
No matter who you are sharing information with, or in what context, always
consider the relative interests and needs of different audiences and consider
tailoring your communications to reflect these.
Think carefully about what information is relevant, and which messages are
most compelling. Returning to your key research questions can help to focus
the messages and avoid any risk of information or data overload.
Finally, make sure that you set aside adequate time to use the findings to
inform the future work of you and your partners.
Use the conclusions you have drawn and the underpinning information to
identify the key lessons learnt from the research, the implications for future
delivery or engagement activities, and any additional / future research needed.
Where you can, share findings with your partners (and ideally more widely) to
help ensure that your research delivers value above and beyond that delivered
directly to your organisation.
1. Make sure you have a clear research objective / purpose in mind from the
outset and use this to define an agreed set of research questions.
2. Select only the social integration measures which are relevant to your
research questions: as many or as few measures as you feel comfortable
with.
3. Identify what is already known about your question(s): work with your
partners to help scope the research and collate baseline information.
6. Be clear and open about how data and information is being used from the
outset, ensuring alignment with all rules and regulations regarding sharing
and confidentiality.
7. Make sure you are balanced in reporting and honest about any gaps or
weaknesses in the information collected.
Tool 12 identifies three ‘filters’ and supporting questions to help you tailor and
plan your research:
See
This toolkit introduces the overall process which can be used to understand
social integration.
The Mayor’s All of Us Social Integration Strategy and 2020 Social Integration
Snapshot provide a useful starting point in helping you to define and plan your
research. Similarly, the GLA’s database of social integration intelligence provides
useful baseline intelligence to help you conceptualise and frame your work.
At a more practical level, the London Prosperity Board’s 2019 research report
provides inspiration for planning and delivering hyper-local research within
London’s neighbourhoods.
Aside from this, there are many wider external resources available which will
support your work. These are referred to where relevant throughout this toolkit
and include:
The National Centre for Research Methods, is a good starting point for
information on social research, providing a range of tools and guidance
documents on approaches to quantitative and qualitative research.
Nesta and the Alliance for Useful Information have developed a range of
guides and tools to help you plan, deliver and analyse your research. Good
starting points include the ‘DIY Toolkit’, which includes a range of tools and
‘canvases’, and ‘Using Research Evidence: A Practice Guide’, which provides
more in-depth information on different approaches to undertaking research.
What Works Centre for Local Economic Growth: a research body established
by government to support local economic development provides a wide library
of resources, including a series of blogs on how to undertake good evaluation
and wider resources on how to evaluate projects across a range of policy
areas
TO O L S TO
SU P PO RT
SO C IAL
I NT E G R AT IO N
M E ASU R E M E N T
Twelve practical tools have been developed to support with the social
integration measurement process. These are designed to be used alongside
the guidance provided in Part B of this toolkit.
TO O L 2 . D E FI N I NG YO UR RE SE A RC H QU E STIONS: CA NVAS
TO O L 5 . D E CI D I N G O N YOU R RE SE A RC H A PPROACH
(Q UAN T I TAT I VE AN D Q UALITATIV E )
A series of filters and questions to help you tailor you research to your
specific organisational and thematic context
Identifying a clear set of questions to frame your research will help you to
develop your approach, maintain focus throughout the research process, and
structure your analysis and reporting.
The ‘canvas’ below aims to help you summarise the context that you are
working within, and, from this, to define the focus of your research.
Research Focus
What are the most important
questions you want your
research to answer (identify no
more than 5)?
Change Characteristics
if relevant what What
long-term characteristics
difference do you do you want to
want / expect to understand?
see?
The full list of Social Integration Measures is provided in the table overleaf,
with links to possible data sources (where relevant) and sample survey
questions.
The survey questions are quantitative with answers and are largely scored on a
standard likert or binary scale (see summary tables below).
Further detail on the measures can be accessed from the GLA via the following
link: https://data.london.gov.uk/dataset/social-integration-headline-measures
The spreadsheet contains the full list of measures and definitions and baseline
data for each measure for London, drawing on government datasets, and the
result of the survey of Londoners.
Yes/No Agree/Disagree
1 = Yes 1 = Agree
2 = No 2 = Disagree
Relationships
Theme Measure Existing Geography Standard survey question(s)
source coverage
adults whose London- similar age as you/ are of the same ethnic
friends have the ers group as you / have a similar level of educa-
same character- tion as you / have similar incomes to you?
18-19
istics as them
(1.All similar 2.More than half 3.About half
4.Less than half)
Proportion of Survey of London As part of your wider social group (e.g. col-
adults reporting London- leagues at work, other parents at the school
positive fre- ers gate, neighbours you chat with regularly),
quent contact how often do you spend time with adults who
18-19
with people with are; much younger than you/much older than
different cha- you/of a different social class to you/of a
Social mixing
Proportion who MOPAC Local To what extent do you agree or disagree with
agree that this Public authority & the following: My local area is a place where
Neighbourhood
Participation
Theme Measure Existing Geography Standard survey question(s)
source coverage
Proportion who Taking London & We would like you think about the things
Participation in leisure activities
have partici- part sur- above you do nowadays. Please look at this list and
pated in leisure vey select which things you have done in the last
activities in the month:
(2019 -
last month, by
annual) 1. Spend time with friends/family 2.Go to
type of activity
pubs/bars/clubs 3.Watch TV 4.Go to parks
5.Play sports 6.Exercise 7.Go to cinema 8.At-
tend church/mosque/place of worship 9.Visit
museums/galleries 10.Go to theatre/music
concerts 11.Play video/computer games
12.Attend local community festivals and
events 13. None of these
Proportion of Taking London & In the last 12 months, have you done any
Volunteering
such as a friend,
a neighbour or
anybody else
who is not a
family member
in the last 12
months
(annual)
12 months, by
1. Campaigning on behalf of a political party
type of activity
2. Trying to set up a new service/amenity for
local residents 3. Trying to stop something
else happening in your local area 4. Run-
ning local services on a voluntary basis (e.g.
childcare, youth services, parks, community
centres) 5.Organising a community event (e.g.
street party) 6. Another local issue (specify)
7. None of them
Equality
Theme Measure Existing Geography Standard survey question(s)
source coverage
employment, or
training
at home who 18-19 (an- a doctor? 1. Very good 2. Good 3. Not very
report that their nual) good 4. Not good at all
language is not
very good or not
good when they
need to speak
English
Proportion Survey of London In the last 12 months, do you feel that you
who have been London- have been treated unfairly by people, other
treated unfairly ers than your friends or family, for any of the rea-
Unfair treatment
who in their last ers ancy end? Please select all that apply:
tenancy were
asked to leave 18-19 (an- 1. I/we wanted to move because the accom-
by their land- nual) modation was in poor condition
accommodation
Outcomes
Theme Measure Existing Geography Standard survey question(s)
source coverage
Proportion who Survey of London How strongly do you feel you belong to your
feel they belong London- local area? And London?
belonging
Feeling of
Proportion who Family Local Overall, how satisfied are you with your life
well-being
Personal
You should aim to focus on those which are most relevant, important and
‘appropriate’ to your context or project, while also being realistic about your
resource and capacity (i.e. how many social integration measures can you
collect information for when set in the context of your wider research).
I NI T I A L F I LTE RI N G OF M E AS U RE S
Basket 1.
Final set of Social integration Measures
Basket 2.
Final set of research measures
The purpose of your research will dictate the balance you require between
quantitative or qualitative insights.
Tool 5 summarises the differences between the two, and implications for how
you plan and approach your research.
Further Reading: The National Centre for Research Methods provides a range of tools and
guidance documents on approaches to quantitative and qualitative research approaches.
We have identified seven key areas of focus which act as a checklist, and
which taken together will to help you establish measures and clear evidence
collections processes.
Part 1. Set out briefly the overall purpose and focus of the
Research research, and a set of specific research questions which
Purpose identify 3-5 Key areas of focus.
Part 4. Identify the measures which you will use within your
Measures research - both social integration focused and any wider
measures you want to introduce. Where relevant, you
should include any baseline information which exists,
and set out any goals which you expect / hope to see /
achieve (and by when).
Part 6. Set out the resources you will use to collect evidence,
Resources and focusing on the need for robust and timely reporting.
Practicalities
• Helping you to plan your research and set your baseline by helping you
to understand the socio-demographic context of your local area or the
individuals / groups that you are working with
• Providing more focused intelligence for certain social integration measures
• Providing intelligence to help you benchmark and compare your social
integration intelligence to wider London averages.
Key data sets and sources are provided in the table; please also refer to the full
measures index (Tool 3) for a list of data sources for each measure.
https://data.london.gov.uk/dataset/social-integration-headline-measures
This questionnaire template has been designed to allow users to select the
questions that are most relevant for their research purpose.
Some relevant questions from this template could also be incorporated into
any existing questionnaire you might already use.
Social Integration Coverage: Relationships Pillar 1.3.1 As part of your wider social group, how often
do you spend time with adults who are; 1. much
S E CT I O N NOTE S younger than you/ 2. much older than you/ 3. of a
In this section, additional questions could be different social class to you/ 4. of a different ethnic-
added depending on your research purpose. For ity to you?*R
example, if you are investigating the health or 1.Never
well-being of a community or group, you could add 2.Occasionally
questions around loneliness (e.g. How often, if at 3.Sometimes
all are you in face-to-face contact with 1. Family 4.Quite a lot
members / 2. Friends you do not live with?). 5.All the time
If you are more interested in digital uses, you 1.3.2 Would you say that it is:*R
could ask how people are using internet for (e.g. 1. Very positive (for example, only good experiences,
access council services, find what to do in my they are friendly to you)
local area, connect with friends etc.) 2. Mostly positive
3. Neutral
E X A M PL E CON TE N T 4. Mostly negative
Now some questions about your friends, family 5. Very negative (for example, only bad experiences,
and other people you meet in your local area or they are mean to you)
London.
1.4 How often, if at all, are you in face-to-face
1.1 What proportion of your friends 1. are of a contact with 1. family members/ 2. friends you
similar age as you/ 2. are of the same ethnic as do not live with?
you/ 3. have similar incomes to you?*R 1. At least once a day
1. All similar 2. 4-6 times a week
2. More than half 3. 2-3 times a week
3. About half 4. Around once a week
4. Less than half 5. Around once a fortnight
5. I don’t have any friends 6. Around once a month
7. Less than once a month
1.2 Now please think about the people close to 8. Never
you such as your spouse or partner, immediate
family, and friends. How much can you rely on 1.5. How strongly do you agree or disagree
them if you have a serious problem?*R with the following statement: Generally, I
1 A lot borrow things and exchange favours with my
2 Somewhat neighbours. *R
3 A little 1. Definitely agree
4 Not at all 2. Tend to agree
3. Tend to disagree
In the previous set of questions we asked about 4. Definitely disagree
the people closest to you, such as your immediate
family and friends. Now we would like you to think 1.6.1 Have you accessed any social messaging
more broadly about your wider social group – the sites or applications in the last 12 months (e.g.
different people you spend time with in other Whatsapp, Skype, Facebook, Snapshat)?
situations e.g. colleagues at work, other parents 1. Yes
at the school gate, neighbours you chat with 2. No
regularly etc.
1.6.2 How often do you access sites or
applications such as these
1.Several times a day
2.At least once a day
3.Once a week
4.Less than that
The next questions ask about your feelings on
Social Integration Coverage: Participation Pillar 2.3 We would now like you to think about the
things you do nowadays. Please look at this list
S E CT I O N NOTE S and select which things you have done in the
The government Community Life Survey is held last month. Please select all that apply*P
annually to track trends and developments in 1. Spend time with friends/family
areas such as volunteering, charitable giving, local 2. Go to pubs/bars/clubs
action and networks and wellbeing. 3. Watch TV
4. Go to parks
While the data cannot be aggregated at a very 5. Play sport
local level, using some of the Community Life 6. Exercise
Survey questions in your questionnaire can be 7. Go to cinema
useful for comparing your findings with findings at 8. Attend church / mosque / place of worship
a regional and national level. https://www.gov.uk/ 9. Visit museums / galleries
government/collections/community-life-survey 10. Go to theatre / music concerts
11. Play video / computer games
E X A M PL E CON TE N T 12. Attend local community festivals and events
Firstly, we’d like to ask some questions about your 13. None of these
experience of living in your local area. Please think
of the area within 15- 20 minutes walking distance The next set of questions are about any unpaid
from your home. help and work you may have done.
2.1 How long have you lived in your local area? 2.4 In the last 12 months, have you given any
1. Less than 1 year unpaid help to a person, such as a friend, a
2. 1 year or more, but less than 2 years neighbour or anybody else who is not a family
3. 2 years or more, but less than 5 years member?*P
4. 5 years or more, but less than 10 years 1. Yes
5. 10 years or more 2. No
2.2. Do you think that over the past two years 2.5 In the last 12 months, have you done any
your area has ...? forms of voluntary work ?*P
1. Got better to live in 1. Yes
2. Got worse to live in 2. No
3. Not changed much (hasn’t got better or worse)
4. Have not lived here long enough to say
SECTI ON 3: YOU RS E L F
However, asking too many questions can backfire. 3.2 What was your age at your last birthday?
Some respondents may become concerned or 16…99
aggravated by having to answer a large number of
demographic questions. 3.3 What is your nationality?
List
Additionally, they may feel that they will
compromise their confidentiality, and others may 3.4 Which country you were born in?
perceive the questions as an invasion of privacy. List
Thoroughly review all survey questions during the
design process. Decide which guest demographics 3.5 Which language do you speak most often at
are the most critical to your study. home?
1. English
For questions on financial resilience (5.11, 5.12 2. Other language:……
and 5.13), the Financial Life Survey (FCA) is held
biennially to track UK adults needs and experiences 3.6 In day-to-day life, how good are you at
with financial services and their financial situation. speaking English when you need to? For
example to have a conversation on the
While the data cannot be aggregated at a very local telephone or talk to a professional such as a
level, using some of Financial Life Survey questions teacher or a doctor?*E
in your questionnaire can be useful for comparing 1. Very good
your findings with findings at national level. 2. Fairly good
https://www.fca.org.uk/publications/research/ 3. Not very good
understanding-financial-lives-uk-adults 4. Not at all good
How you wish to report back on area / thematic based research will depend on
the specific purpose of the research, and the audience of your reporting.
Reporting may take several forms, from detailed written outputs, to softer
forms of communication (e.g. case studies and films).
Section 5. Set out how the research findings will be used, and
Next Steps explore whether or not any follow up research is
required.
Case studies should form a key part of your reporting; they help to bring
research to life and connect the findings to your audience.
While there is no set template for case studies, the following principles will
help you ensure the case studies you develop add value to your reporting
process.
4. Publishing Make sure you secure any necessary sign off before
your case publishing case studies. This might be agreement from
studies groups / individuals that they are happy to be used as
a case study, or agreement from those involved in the
specific content which has been drafted.
We have identified three ‘filters’ to help you tailor and plan your research.
These are summarised in the diagram below, with key questions and
considerations then explored in turn over the following pages.
Filter 1
What is your • Understanding the experiences of Londoners
research • Understanding Places and their Communities
purpose? • Understanding the impact of Action
Defining a clear research purpose should key early priority in your research
planning process.
The specific purpose of your research will influence all stages and steps of
your research from initial planning through to final reporting.
Key Considerations
What is your
research Stage 1 Stage 2 Stage 3
purpose? Plan Collect Research
Developing a clear theory of change (see Tool 1) at the outset can help with
this process, ensuring that subsequent research and reporting is grounded in
a good understanding of change which is being directly targeted / affected,
versus change which is more indirect.
Key Considerations
What is the
thematic
Stage1 Stage2 Stage3
focus of your
Plan Collect Reflect
research?
The type of organisation you are / represent will have a significant influence on
your approach to the research – both in terms
Key Considerations
What type of
organisation are Stage 1 Stage 2 Stage 3
you? Plan Collect Reflect
Who are the groups and individuals that you work with
Education
and how well do you understand them?
& Health
Institutions What information do you routinely collect which could
support London’s understanding of social integration?
PR ACT ICAL
E X AM P L E S
O F SO C IA L
I NT E G R AT IO N
M E ASU R E M E N T
This section provides a small number of examples of some of ways which
different organisations across the UK are prioritising social integration
measurement, and the practical approaches which are being applied.
We are keen to develop this further as a resource for all those engaged in
social integration measurement. To support with this, we encourage you to
submit examples of what you are doing to collect social evidence, so that we
can develop a rich set of common practical approaches, experiences, and
learning.