Skip to main content

Anne Adams

Followers

16

Following

1

Co-author

1

Public Views

Professor Adams is chair for engaged practice and research and leading IET knowledge exchange, previously OU professional development director and director for knowledge exchange in the national ‘centre for policing research and learning’. Currently Professor Adams has been appointed a visting Fellow to the Palace of Westminster through POST, delivering a new approach to ‘Research Horizon Scanning’ for UK parlimentarians to review. She has over 100 peer reviewed publications and a diverse range of large-scale international research portfolio (totally over 6 Million) producing extensive collaborative interdisciplinary research and knowledge exchange experience (e.g. Microsoft, BT, Cannon, GOOGLE, NHS) producing award-winning outputs (e.g. WISE Award presented by HRH Princess Royal). Currently her research interests are around ‘tricky topics’ and ‘evidence cafes’ for evidence based policy making and teaching and learning design.

less

The University of Sheffield

M. Mahruf C. Shohel

University Of Roehampton

University College London

Interests

Uploads

Papers by Anne Adams

Police Knowledge Exchange: Summary Report

An Open Research University

This is the final report of the Open University’s RCUK-funded Public Engagement with Research Cat... more This is the final report of the Open University’s RCUK-funded Public Engagement with Research Catalyst, ‘An open research university’, a project designed to create the conditions in which engaged research can flourish. The report describes an evidence-based strategy designed to embed engaged research within the University’s strategic planning for research and the operational practices of researchers. This programme of organisational change was informed by action research, working collaboratively with researchers at all levels across the institution to identify and implement strategies that work for them and the stakeholders, user communities and members of the public that engage with their research. Through a combination of surveys, interviews and interventions, we identified a number of challenges and proposed solutions to address them. For example, we found that researchers have a relatively narrow view of engaged research and the communities with which they interact and very few ...

Innovating Pedagogy 2015: Open University Innovation Report 4

This series of reports explores new forms of teaching, learning and assessment for an interactive... more This series of reports explores new forms of teaching, learning and assessment for an interactive world, to guide teachers and policy makers in productive innovation. This fourth report proposes ten innovations that are already in currency but have not yet had a profound influence on education. To produce it, a group of academics at the Institute of Educational Technology in The Open University collaborated with researchers from the Center for Technology in Learning at SRI International. We proposed a long list of new educational terms, theories, and practices. We then pared these down to ten that have the potential to provoke major shifts in educational practice, particularly in post-school education. Lastly, we drew on published and unpublished writings to compile the ten sketches of new pedagogies that might transform education. These are summarised below in an approximate order of immediacy and timescale to widespread implementation.

Artistic Participatory Video-Making for Science Engagement

This paper uses theatre to frame reflexive discussions on the use of participatory video making f... more This paper uses theatre to frame reflexive discussions on the use of participatory video making for science engagement. The 'JuxtaLearn' research project is presented as a case-study that focuses on performance concepts such as audience, purpose, improvisation or final production as a lens for supporting technology-enabled creative exploration. Three different approaches were taken to creative participatory video making processes: co-creation by learners, as a communication tool for researchers and as a public engagement tool. Differing expectations about the timing and aim of the research process created considerable debate among the research team regarding the control of and purpose of filmmaking. It was not the topic of debate within the film that was deemed controversial, but more who, when and in what ways these debates occurred. Theatrical and HCI concepts of audience, performance ownership, improvisation and storyboarding, boundary object creation, participation and boundary creatures are foci of debate within the project.

Effective ways to use nonpersonal information in healthcare: report from a workshop held at University College London 15-16 April 2004

Health Libraries Group Newsletter, 2004

New information technologies are being introduced in the UK National Health Service as resources ... more New information technologies are being introduced in the UK National Health Service as resources for the acquisition of clinical knowledge. These are forcing working practices to adapt and are affecting and challenging perceived roles, relationships and expectations of patients and health professionals alike. Effective ways to use nonpersonal information in healthcare was a two-day workshop hosted by UCL Interaction Centre at University College London intended to provide a forum for practioners and researchers working in the area of ...

A qualitative approach to HCI research

Research Methods for Human-Computer Interaction

GeoHCI for learning in the wild

This position paper gives exemplars of location-based 'in the wild' learning and their relationsh... more This position paper gives exemplars of location-based 'in the wild' learning and their relationship to GeoHCI, and also describes the challenges and research questions inherent in doing so. We present several projects that encompass both formal and informal learning experiences. We discuss the issues arising from the use of outdoor in the wild 'blended spaces' to change geoscience practices, together with a suggestion that we should also be considering a more responsible and scalable approach when designing these interventions.

Evocative Computing – Creating Meaningful Lasting Experiences in Connecting with the Past

Lecture Notes in Computer Science, 2013

We present an approach-evocative computing-that demonstrates how 'at hand' technologies can be 'p... more We present an approach-evocative computing-that demonstrates how 'at hand' technologies can be 'picked up' and used by people to create meaningful and lasting experiences, through connecting and interacting with the past. The approach is instantiated here through a suite of interactive technologies configured for an indoor-outdoor setting that enables groups to explore, discover and research the history and background of a public cemetery. We report on a two-part study where different groups visited the cemetery and interacted with the digital tools and resources. During their activities serendipitous uses of the technology led to connections being made between personal memories and ongoing activities. Furthermore, these experiences were found to be long-lasting; a follow-up study, one year later, showed them to be highly memorable, and in some cases leading participants to take up new directions in their work. We discuss the value of evocative computing for enriching user experiences and engagement with heritage practices.

Augmented Reality and Mobile Learning

International Journal of Mobile and Blended Learning, 2013

In this paper, the authors examine the state of the art in augmented reality (AR) for mobile lear... more In this paper, the authors examine the state of the art in augmented reality (AR) for mobile learning. Previous work in the field of mobile learning has included AR as a component of a wider toolkit but little has been done to discuss the phenomenon in detail or to examine in a balanced fashion its potential for learning, identifying both positive and negative aspects. The authors seek to provide a working definition of AR and to examine how it can be embedded within situated learning in outdoor settings. The authors classify it according to key aspects (device/technology, mode of interaction/learning design, type of media, personal or shared experiences, whether the experience is portable or static, and the learning activities/outcomes). The authors discuss the technical and pedagogical challenges presented by AR, before looking at ways in which it can be used for learning. Finally, the paper looks ahead to AR technologies that may be employed in the future.

Patient information needs: pre- and post-consultation

Health Informatics Journal, 2006

This paper presents findings from a study of information seeking behaviour by National Health Ser... more This paper presents findings from a study of information seeking behaviour by National Health Service patients which explored motivational triggers for infor- mation needs. Previous research has highlighted the importance of contextual elements in users' changing information needs. This paper highlights how those needs may centre on specific events: in particular, a patient's consultation with their doctor. Patients initiate information seeking to assess whether they need clinical intervention, in preparation for the patient–doctor consultation and to verify the diagnosis or treatment stemming from that consultation. The study has revealed that having confidence in health practitioners is one key motiva- tion for information seeking. Another is a desire to use health service resources judiciously, efficiently and effectively.

Questionnaires, in-depth interviews and focus groups

Research Methods for Human-Computer Interaction

For guidance on citations see FAQs.

The different roles of 'design process champions' for digital libraries in African higher education Journal Article The Different Roles of 'Design Process Champions' for Digital Libraries in African Higher Education

The concept of design stakeholders is central to effective design of digital libraries. We report... more The concept of design stakeholders is central to effective design of digital libraries. We report on research findings that identified the presence of a key subset of stakeholders which we term 'design process champions'. Our findings have identified that these champions can change interaction patterns and the eventual output of the other stakeholders (project participants) in the design process of digital library projects. This empirical research is based upon 38 interviews with key stakeholders and a review of documentary evidence in ten innovative digital library design projects (e.g. mobile clinical libraries) located in three African universities in Kenya, Uganda and South Africa. Through a grounded theory approach two different types of the 'design process champions' emerged from the data with varying levels of effectiveness in the design process: (i) domain champions and (ii) multidisciplinary champions. The domain champions assume a 'siloed' approach ...

The Different Roles of ‘Design Process Champions ’ for Digital Libraries in African Higher Education

and other research outputs The different roles of ‘design process champions ’ for digital librari... more

Sharing, privacy and trust issues for photo collections

Digital libraries are quickly being adopted by the masses. Technological developments now allow c... more Digital libraries are quickly being adopted by the masses. Technological developments now allow community groups, clubs, and even ordinary individuals to create their own, publicly accessible collections. However, users may not be fully aware of the potential privacy implications of submitting their documents to a digital library, and may hold misconceptions of the technological support for preserving their privacy. We present results from 18 autoethnographic investigations and 19 observations / interviews into privacy issues that arise when people make their personal photo collections available online. The Adams’ privacy model is used to discuss the findings according to information receiver, information sensitivity, and information usage. Further issues of trust and ad hoc poorly supported protection strategies are presented. Ultimately while photographic data is potentially highly sensitive, the privacy risks are often hidden and the protection mechanisms are limited.

Evidence Cafés and Practitioner Cafés supported by online resources: A route to innovative training in practice based approaches

Current radical changes in the Police service internationally and in England and Wales are being ... more Current radical changes in the Police service internationally and in England and Wales are being driven by movements to adopt an Evidence-Based Practice (EBP) approach to policing. However this poses a challenge as early adopters have experienced resistance to EBP, a relatively unknown, and more importantly misunderstood approach for policing (Sherman, 2015). This resistance is not limited to police with international research highlighting implementation issues for evidence based medicine (Altman, 1996; Fairhurst & Dowrick, 1996; Murphy and Adams, 2005), evidence based management (Adams & Sasse, 1999; Rousseau, 2012), and evidence based teaching (Beista, 2007, Perry & Smart, 2007; Adams & Clough, 2015). One reason is the lack of training in EBP, which is coupled with recent concerns over the general quality of training and level of professionalism within UK police organisation (Davies et al, 1996). There have been international initiatives aimed at increasing learning around evidenc...

1 Modelling creativity through knowledge transfer and boundary objects

It has been long understood that creative approaches can increase student engagement in learning.... more It has been long understood that creative approaches can increase student engagement in learning. However, recent research has started to uncover a clear impact upon learning progression and transforming student understanding across disciplines. This paper details a series of case studies from the JuxtaLearn project conducted across Europe in schools and HE. The results show an increase in students’ depth of understanding (deep learning) through creative juxtaposed approaches, in particular using participatory video making. For this research, an ecology of different devices (mobiles, tablets, tabletops, large screens and computers) was used to scaffold a juxtaposed collaborative learning process supporting a deeper understanding of ‘tricky topics’. We have worked with >114 students in science, maths, technology, drama and religious education within schools and universities in the UK and across Europe. The findings identified issues around the process of storytelling learning topi...

Privacy Issues in Ubiquitous Multimedia Environments: Wake Sleeping Dogs, or Let Them Lie?

Many users are not aware of the potential privacy implications of ubiquitous multimedia applicati... more Many users are not aware of the potential privacy implications of ubiquitous multimedia applications. Decision-makers are often reluctant to raise users' awareness, since this may open a "can of worms" and deter potential users. We conducted an opportunistic study after videoconferencing developers placed a camera in the common room of their university department, broadcasting the video on the Internet. The email debate following the common room users "discovery" of the camera's existence was analyzed as well as 47 anonymous questionnaire responses. Three distinct types of responses were identified, varying with the media type (audio vs. video) transmitted and scope of distribution (local vs. global). The groups also differ in their perception of the common room situation (public vs. private) and the degree of control exerted by observers and those observed. We conclude that privacy implications of ubiquitous multimedia applications must be made explicit....

An outreach librarian projects impact upon successful digital library uptake

This paper reviews the implementation of digital libraries via communities of practice and an out... more This paper reviews the implementation of digital libraries via communities of practice and an outreach clinical librarian. 26 In-depth interviews were conducted across 8 different clinical teams within a London based primary care trust. The interviews and an observational study of the team and information mediator collaborating during a drop-in session, took place over a 6 month period. The findings reveal how effective implementation procedures can produce a positive user motivation towards digital libraries and evidenced based medicine (EBM) that previously was perceived as a chore. An information facilitator implemented within the community which could adapt to and change practices according to individual and group needs was seen as empowering to both the community and the individual.

A whole picture is worth a thousand words

ACM SIGCHI Bulletin - a supplement to interactions

... Management using security cameras to evaluate their workforce breaches expected privacy risks... more

Enabling Live Dialogic and Collaborative Learning between Field and Indoor Contexts

This paper explores how field and indoor based students can be connected so that their contrastin... more This paper explores how field and indoor based students can be connected so that their contrasting circumstances and capabilities are used as a basis for learning. We describe the design of the 'Out There and In Here' system and activity. Using naturalistic evaluations in the context of higher education earth science, we find evidence that this approach can be beneficial in developing essential skills, by supporting dialogue and collaboration across diverse contexts. This provokes novel forms of reflection and motivation, and could inspire a new generation of learning tools combining mobile and collaborative technologies. We discuss important issues in this design space, such as asymmetrical dependencies and structures for dialogic and collaborative learning.

Police Knowledge Exchange: Summary Report

An Open Research University

This is the final report of the Open University’s RCUK-funded Public Engagement with Research Cat... more This is the final report of the Open University’s RCUK-funded Public Engagement with Research Catalyst, ‘An open research university’, a project designed to create the conditions in which engaged research can flourish. The report describes an evidence-based strategy designed to embed engaged research within the University’s strategic planning for research and the operational practices of researchers. This programme of organisational change was informed by action research, working collaboratively with researchers at all levels across the institution to identify and implement strategies that work for them and the stakeholders, user communities and members of the public that engage with their research. Through a combination of surveys, interviews and interventions, we identified a number of challenges and proposed solutions to address them. For example, we found that researchers have a relatively narrow view of engaged research and the communities with which they interact and very few ...

Innovating Pedagogy 2015: Open University Innovation Report 4

This series of reports explores new forms of teaching, learning and assessment for an interactive... more This series of reports explores new forms of teaching, learning and assessment for an interactive world, to guide teachers and policy makers in productive innovation. This fourth report proposes ten innovations that are already in currency but have not yet had a profound influence on education. To produce it, a group of academics at the Institute of Educational Technology in The Open University collaborated with researchers from the Center for Technology in Learning at SRI International. We proposed a long list of new educational terms, theories, and practices. We then pared these down to ten that have the potential to provoke major shifts in educational practice, particularly in post-school education. Lastly, we drew on published and unpublished writings to compile the ten sketches of new pedagogies that might transform education. These are summarised below in an approximate order of immediacy and timescale to widespread implementation.

Artistic Participatory Video-Making for Science Engagement

This paper uses theatre to frame reflexive discussions on the use of participatory video making f... more This paper uses theatre to frame reflexive discussions on the use of participatory video making for science engagement. The 'JuxtaLearn' research project is presented as a case-study that focuses on performance concepts such as audience, purpose, improvisation or final production as a lens for supporting technology-enabled creative exploration. Three different approaches were taken to creative participatory video making processes: co-creation by learners, as a communication tool for researchers and as a public engagement tool. Differing expectations about the timing and aim of the research process created considerable debate among the research team regarding the control of and purpose of filmmaking. It was not the topic of debate within the film that was deemed controversial, but more who, when and in what ways these debates occurred. Theatrical and HCI concepts of audience, performance ownership, improvisation and storyboarding, boundary object creation, participation and boundary creatures are foci of debate within the project.

Effective ways to use nonpersonal information in healthcare: report from a workshop held at University College London 15-16 April 2004

Health Libraries Group Newsletter, 2004

New information technologies are being introduced in the UK National Health Service as resources ... more New information technologies are being introduced in the UK National Health Service as resources for the acquisition of clinical knowledge. These are forcing working practices to adapt and are affecting and challenging perceived roles, relationships and expectations of patients and health professionals alike. Effective ways to use nonpersonal information in healthcare was a two-day workshop hosted by UCL Interaction Centre at University College London intended to provide a forum for practioners and researchers working in the area of ...

A qualitative approach to HCI research

Research Methods for Human-Computer Interaction

GeoHCI for learning in the wild

This position paper gives exemplars of location-based 'in the wild' learning and their relationsh... more This position paper gives exemplars of location-based 'in the wild' learning and their relationship to GeoHCI, and also describes the challenges and research questions inherent in doing so. We present several projects that encompass both formal and informal learning experiences. We discuss the issues arising from the use of outdoor in the wild 'blended spaces' to change geoscience practices, together with a suggestion that we should also be considering a more responsible and scalable approach when designing these interventions.

Evocative Computing – Creating Meaningful Lasting Experiences in Connecting with the Past

Lecture Notes in Computer Science, 2013

We present an approach-evocative computing-that demonstrates how 'at hand' technologies can be 'p... more We present an approach-evocative computing-that demonstrates how 'at hand' technologies can be 'picked up' and used by people to create meaningful and lasting experiences, through connecting and interacting with the past. The approach is instantiated here through a suite of interactive technologies configured for an indoor-outdoor setting that enables groups to explore, discover and research the history and background of a public cemetery. We report on a two-part study where different groups visited the cemetery and interacted with the digital tools and resources. During their activities serendipitous uses of the technology led to connections being made between personal memories and ongoing activities. Furthermore, these experiences were found to be long-lasting; a follow-up study, one year later, showed them to be highly memorable, and in some cases leading participants to take up new directions in their work. We discuss the value of evocative computing for enriching user experiences and engagement with heritage practices.

Augmented Reality and Mobile Learning

International Journal of Mobile and Blended Learning, 2013

In this paper, the authors examine the state of the art in augmented reality (AR) for mobile lear... more In this paper, the authors examine the state of the art in augmented reality (AR) for mobile learning. Previous work in the field of mobile learning has included AR as a component of a wider toolkit but little has been done to discuss the phenomenon in detail or to examine in a balanced fashion its potential for learning, identifying both positive and negative aspects. The authors seek to provide a working definition of AR and to examine how it can be embedded within situated learning in outdoor settings. The authors classify it according to key aspects (device/technology, mode of interaction/learning design, type of media, personal or shared experiences, whether the experience is portable or static, and the learning activities/outcomes). The authors discuss the technical and pedagogical challenges presented by AR, before looking at ways in which it can be used for learning. Finally, the paper looks ahead to AR technologies that may be employed in the future.

Patient information needs: pre- and post-consultation

Health Informatics Journal, 2006

This paper presents findings from a study of information seeking behaviour by National Health Ser... more This paper presents findings from a study of information seeking behaviour by National Health Service patients which explored motivational triggers for infor- mation needs. Previous research has highlighted the importance of contextual elements in users' changing information needs. This paper highlights how those needs may centre on specific events: in particular, a patient's consultation with their doctor. Patients initiate information seeking to assess whether they need clinical intervention, in preparation for the patient–doctor consultation and to verify the diagnosis or treatment stemming from that consultation. The study has revealed that having confidence in health practitioners is one key motiva- tion for information seeking. Another is a desire to use health service resources judiciously, efficiently and effectively.

Questionnaires, in-depth interviews and focus groups

Research Methods for Human-Computer Interaction

For guidance on citations see FAQs.

The different roles of 'design process champions' for digital libraries in African higher education Journal Article The Different Roles of 'Design Process Champions' for Digital Libraries in African Higher Education

The concept of design stakeholders is central to effective design of digital libraries. We report... more The concept of design stakeholders is central to effective design of digital libraries. We report on research findings that identified the presence of a key subset of stakeholders which we term 'design process champions'. Our findings have identified that these champions can change interaction patterns and the eventual output of the other stakeholders (project participants) in the design process of digital library projects. This empirical research is based upon 38 interviews with key stakeholders and a review of documentary evidence in ten innovative digital library design projects (e.g. mobile clinical libraries) located in three African universities in Kenya, Uganda and South Africa. Through a grounded theory approach two different types of the 'design process champions' emerged from the data with varying levels of effectiveness in the design process: (i) domain champions and (ii) multidisciplinary champions. The domain champions assume a 'siloed' approach ...

The Different Roles of ‘Design Process Champions ’ for Digital Libraries in African Higher Education

and other research outputs The different roles of ‘design process champions ’ for digital librari... more

Sharing, privacy and trust issues for photo collections

Digital libraries are quickly being adopted by the masses. Technological developments now allow c... more Digital libraries are quickly being adopted by the masses. Technological developments now allow community groups, clubs, and even ordinary individuals to create their own, publicly accessible collections. However, users may not be fully aware of the potential privacy implications of submitting their documents to a digital library, and may hold misconceptions of the technological support for preserving their privacy. We present results from 18 autoethnographic investigations and 19 observations / interviews into privacy issues that arise when people make their personal photo collections available online. The Adams’ privacy model is used to discuss the findings according to information receiver, information sensitivity, and information usage. Further issues of trust and ad hoc poorly supported protection strategies are presented. Ultimately while photographic data is potentially highly sensitive, the privacy risks are often hidden and the protection mechanisms are limited.

Evidence Cafés and Practitioner Cafés supported by online resources: A route to innovative training in practice based approaches

Current radical changes in the Police service internationally and in England and Wales are being ... more Current radical changes in the Police service internationally and in England and Wales are being driven by movements to adopt an Evidence-Based Practice (EBP) approach to policing. However this poses a challenge as early adopters have experienced resistance to EBP, a relatively unknown, and more importantly misunderstood approach for policing (Sherman, 2015). This resistance is not limited to police with international research highlighting implementation issues for evidence based medicine (Altman, 1996; Fairhurst & Dowrick, 1996; Murphy and Adams, 2005), evidence based management (Adams & Sasse, 1999; Rousseau, 2012), and evidence based teaching (Beista, 2007, Perry & Smart, 2007; Adams & Clough, 2015). One reason is the lack of training in EBP, which is coupled with recent concerns over the general quality of training and level of professionalism within UK police organisation (Davies et al, 1996). There have been international initiatives aimed at increasing learning around evidenc...

1 Modelling creativity through knowledge transfer and boundary objects

It has been long understood that creative approaches can increase student engagement in learning.... more It has been long understood that creative approaches can increase student engagement in learning. However, recent research has started to uncover a clear impact upon learning progression and transforming student understanding across disciplines. This paper details a series of case studies from the JuxtaLearn project conducted across Europe in schools and HE. The results show an increase in students’ depth of understanding (deep learning) through creative juxtaposed approaches, in particular using participatory video making. For this research, an ecology of different devices (mobiles, tablets, tabletops, large screens and computers) was used to scaffold a juxtaposed collaborative learning process supporting a deeper understanding of ‘tricky topics’. We have worked with >114 students in science, maths, technology, drama and religious education within schools and universities in the UK and across Europe. The findings identified issues around the process of storytelling learning topi...

Privacy Issues in Ubiquitous Multimedia Environments: Wake Sleeping Dogs, or Let Them Lie?

Many users are not aware of the potential privacy implications of ubiquitous multimedia applicati... more Many users are not aware of the potential privacy implications of ubiquitous multimedia applications. Decision-makers are often reluctant to raise users' awareness, since this may open a "can of worms" and deter potential users. We conducted an opportunistic study after videoconferencing developers placed a camera in the common room of their university department, broadcasting the video on the Internet. The email debate following the common room users "discovery" of the camera's existence was analyzed as well as 47 anonymous questionnaire responses. Three distinct types of responses were identified, varying with the media type (audio vs. video) transmitted and scope of distribution (local vs. global). The groups also differ in their perception of the common room situation (public vs. private) and the degree of control exerted by observers and those observed. We conclude that privacy implications of ubiquitous multimedia applications must be made explicit....

An outreach librarian projects impact upon successful digital library uptake

This paper reviews the implementation of digital libraries via communities of practice and an out... more This paper reviews the implementation of digital libraries via communities of practice and an outreach clinical librarian. 26 In-depth interviews were conducted across 8 different clinical teams within a London based primary care trust. The interviews and an observational study of the team and information mediator collaborating during a drop-in session, took place over a 6 month period. The findings reveal how effective implementation procedures can produce a positive user motivation towards digital libraries and evidenced based medicine (EBM) that previously was perceived as a chore. An information facilitator implemented within the community which could adapt to and change practices according to individual and group needs was seen as empowering to both the community and the individual.

A whole picture is worth a thousand words

ACM SIGCHI Bulletin - a supplement to interactions

... Management using security cameras to evaluate their workforce breaches expected privacy risks... more

Enabling Live Dialogic and Collaborative Learning between Field and Indoor Contexts

This paper explores how field and indoor based students can be connected so that their contrastin... more This paper explores how field and indoor based students can be connected so that their contrasting circumstances and capabilities are used as a basis for learning. We describe the design of the 'Out There and In Here' system and activity. Using naturalistic evaluations in the context of higher education earth science, we find evidence that this approach can be beneficial in developing essential skills, by supporting dialogue and collaboration across diverse contexts. This provokes novel forms of reflection and motivation, and could inspire a new generation of learning tools combining mobile and collaborative technologies. We discuss important issues in this design space, such as asymmetrical dependencies and structures for dialogic and collaborative learning.