Professional Development

In the 'ARL Assessment Seminar 2014' Category...

ARL New Assessment Professionals Seminar

Monday, March 24, 2014 8:54 pm

“Report Out” from the Space Group

I’ve worn many hats during my years at ZSR, but I was handed a new one this academic year – assessment. Yes, of course I’ve done some assessment in my day, I think we all have done it in some fashion or another. But until this year, I was never given the responsibility for an overall assessment strategy; my experience with it was more on an ad hoc basis, project by project and done formally only when required. So when I was appointed (not elected) as chair of the ZSR Library Assessment Committee last July, I knew the first order of business was to get myself up to speed. If you stay on top of your professional reading, you’ll know that “Assessment” has become one of the Big Topics in recent years as academic (and other) libraries are pressed to demonstrate their value in the changing information landscape.

For some time, ARL has been a leader in the assessment arena, so when I saw they had developed a brand new seminar, “Leading a Strategic Assessment Program in a Research Library: An ARL Seminar for Recently Appointed Assessment Professionals,” I didn’t hesitate to sign up. This was a good move because they capped the in-person seminar at 30 and already have a second one in November filled and a waiting list for future ones….. The seminar was an intensive two day program which was preceded by 3 preparatory assignments and a pre-session webinar. The assignments helped acquaint the seminar faculty (Martha Kyrillidou, Steve Hiller and Raynna Bowlby) with each participant’s current assessment level and with our key assessment issues. By the time we arrived in Washington, DC, they were ready to group the participants by themes that had emerged from everyone’s key issues. Not surprisingly, I was assigned to the “Space” group. The other groups were Collections, Engagement with Faculty Research, Strategic Data and Student Learning. The design of this arrangement allowed each group to discuss frame the various assessment topic around the issues most important to each of us.

They got things off to a good start with a “fireside chat” by three senior administrators (Liz Mengel, Johns Hopkins; Anne Moore, SIU; Gary White, U of Md). They each gave their perspectives on what they considered important to understand when discussing assessment. My takeaways from this include:

  • Assessment needs to be aligned with strategic plans/priorities of the institution
  • Assessment can’t be accomplished by a single person (our committee models spreads the support structure nicely!)
  • Data gathering is not assessment (which requires analysis and evaluation)
  • Organizational culture drives everything

Over the course of the first day, we reviewed basics ranging from sources of traditional library data (think IPEDS, NCES, ASERL), tools (LibPas is an example and is used by ASERL), to different associations and higher ed data collection efforts. Just when I was getting a bit overwhelmed we were told about useful assumptions:

  • your problem/issue is not as unique as you think
  • you have more data/information than you think
  • you need less data/information than you think
  • there are useful methods that are much more simple than you think

Being a fan of qualitative over quantitative, I was glad to hear that there is a move in assessment from inputs (focus on how big/how much) and outputs (focus on use) to outcomes (impact and value). It’s about time to move away from the idea of size as an indicator of excellence or usage statistics (of things like collections, facilities) as a meaningful measure. These don’t tell the story of what people did with them. They don’t tell you the “why.”

Another concept I want to think about is the idea of the preferability of using trend data over a snapshot because data over time has more of an impact in telling the real story of what’s going on.

We spent a great deal of time discussing methods and the importance of asking the right questions before you select an assessment method. A big question is asking what do you want to know? That will inform the method. For assessing space, some methods that are effective are observation, heat mapping, ethnographic, interviews and focus groups.

One of the things they recommended tackling early-on that we actually have started to do is to do a data inventory to find out what data is being collected and whether it is being used. That is a first step before you can talk about using data to drive decision-making.

There was so much more covered during the two days than I can cover here but if you are an assessment aficionado, let me know and I’ll buy you a Starbucks and fill you in on all the details. (Added 3/24: There are some interesting articles in a special issue of Library Quarterly by the keynote speakers at the 2010 Assessment Conference that give a great overview of some of the big topics)

At the end of the seminar we were given a final assignment – to develop a plan to strengthen library assessment in our organization. You may be hearing from me in the next few weeks as I work to accomplish this!

I’ll leave you with my favorite image from my DC visit (you have to know I would take an evening photo walk to the Mall to capture the sights!)

Evening Reflections on the Vietnam Wall

Vietnam Wall


Pages
About
Categories
ACRL
ALA
ALA Annual
ALA Midwinter
ALCTS
ALFMO
ANCHASL
ANSS
APALA
ARL Assessment Seminar 2014
ARLIS
ASERL
ASIS&T
ATLA
Berkman Webinar
Book Repair Workshops
Career Development for Women Leaders Program
Carolina Consortium
CASE Conference
cataloging
Celebration: Entrepreneurial Conference
Charleston Conference
Coalition for Networked Information
code4lib
commons
Conference Planning
Conferences
Copyright Conference
costs
COSWL
CurateGear
Designing Libraries II Conference
DHSI
DigCCurr
Digital Forsyth
Digital Humanities Symposium
Disaster Recovery
Discovery tools
E-books
EDUCAUSE
edUI
Electronic Resources and Libraries
Elon Teaching and Learning Conference
Embedded Librarians
Entrepreneurial Conference
ERM Systems
Evidence Based Library and Information Practice (EBLIP)
Ex Libris Users of North America (ELUNA)
FDLP
First-Year Experience Conference
FRBR
Future of Libraries
Gaming in Libraries
Google Scholar
govdocs
Handheld Librarian
ILLiad Conference
ILS
Immersion
information design
information ethics
Information Literacy
innovation
Innovation in Instruction
Innovative Library Classroom Conference
Inspiration
Institute for Research Design in Librarianship
instruction
IRB101
Journal reading group
Keynote
LAMS Customer Service Workshop
LAUNC-CH
Leadership
Leadership Institute for Academic Librarians
Learning spaces
LibQUAL
Library 2.0
Library Assessment Conference
Library of Congress
licensing
Lilly Conference
LITA
LITA National Forum
LLAMA
LOEX
LRTS
Lyrasis
Management
Marketing
Mentoring Committee
MERLOT
metadata
Metrolina
Music Library Association
NASIG
National Library of Medicine
NC-LITe
NCCU Conference on Digital Libraries
NCICU
NCLA
NCPC
NCSLA
NHPRC-Electronic Records Research Fellowships Symposium
NISO
North Carolina Serials Conference
Offsite Storage Project
OLE Project
online catalogs
online course
Online Learning Summit
OPAC
open access
Open Repositories
Peabody Academic Library Leadership Institute
plagiarism
Podcasting
Preservation
Preservation Activities
Preserving Forsyth LSTA Grant
Professional Development Center
rare books
RBMS
RDA/FRBR
Reserves
RITS
RTSS
RUSA-CODES
SACS-COC
Scholarly Communication
ScienceOnline2010
Site Visits and Tours
Social Stratification in the Deep South
Society of American Archivists
Society of North Carolina Archivists
SOLINET
Southeast Music Library Association
SPARC
STS
subject headings
Sun Webinar Series
symposium
tagging
TALA Conference
Technical Services
technology
ThinkTank Conference
Training
UIPO Symposium
ULG
UNC Teaching and Learning with Technology Conference
Uncategorized
user studies
Vendors
video-assisted learning
visual literacy
WakeSpace
Web 2.0
Webinar
WebWise
WFU China Initiative
Wikis
Women's History Symposium 2007
workshops
WSS
ZSR Library Leadership Retreat
Tags
Archives
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
September 2015
August 2015
July 2015
June 2015
May 2015
April 2015
March 2015
February 2015
January 2015
December 2014
November 2014
October 2014
August 2014
July 2014
June 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
September 2012
August 2012
July 2012
June 2012
May 2012
April 2012
March 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011
February 2011
January 2011
December 2010
November 2010
October 2010
September 2010
August 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008
November 2008
October 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007

Powered by WordPress.org, protected by Akismet. Blog with WordPress.com.