Inclusive Pedagogies & Measuring Complex Domains of Learning for the Liberal Arts – 2 workshops

For related research, see also: Measuring Complex Domains (summer/fall 2018)

Emerging pedagogies for inclusion are keen topics of interest across the liberal arts. Our Teaching & Learning Centers, and our academic support colleagues have a growing body of experience – what works and what doesn’t work – when it comes to supporting our diverse student body academically and as whole persons. Collaboration around these insights and measurements across LACOL has seemed like a useful idea to many. To advance these conversations, two interrelated workshops will be held in the Spring of 2018:

WORKSHOP 2: Measuring Complex Domains of Learning (Inclusive Pedagogies)

  • Date: Friday, April 27
  • Location: Davidson College
  • Workshop Leads:
    • Dr. Brent Maher, Director of Academic Assessment, Davidson College
    • Kristen Eshleman, Director of Digital Innovation, Davidson College
    • Prof. Paul Youngman, Chair of the Digital Humanities Working Group and Professor of German, Washington & Lee University
  • Workshop Resources: Readings & Videos
  • Program: https://emergentedu.org 

WORKSHOP 1: LACOL Dialogue on Inclusive Pedagogies

  • Date: Friday, March 9
  • Location: Haverford College
  • Speakers*:
    • Prof. Verna Case, Assoc. Dean of Faculty, Director of the Teaching and Learning Center, and Beverly F. Dolan Professor of Biology, Davidson College
    • Prof. Jyl Gentzler, John Cooper ’64 Presidential Teaching Professor of Philosophy and Faculty Director of the Center for Teaching and Learning, Amherst College
    • Dr. Riley Caldwell O’Keefe, Director, Center for Teaching and Learning, Amherst College
    • Prof. Jonathon Kahn, Assoc. Professor of Religion, Vassar College
    • Dr. Andrea Nixon, Program Director, Division of Undergraduate Education, National Science Foundation and Director of Educational Research, Carleton College
  • Program: Agenda

Background and Purpose:

The goal of these paired workshops is to start a dialogue across our stakeholders around issue of access and inclusion, and to consider ways in which both qualitative and quantitative assessments might be used to jointly study this aspect (and others) of the liberal arts experience. Read More

QLAB Update and Discussion at LACOL 2018

Sessions: QLAB discussions at LACOL 2018
Discussion Leads – QLAB Core Team:

  • Melissa Eblen-Zayas, Professor of Physics, Carleton College
  • Jonathan Leamon, Director of Instructional Technology, Williams College
  • Laura Muller, Director of Quantitative Skills Programs and Peer Support, Williams College
  • Janet Russell, Director of Academic Technology, Carleton College

Presentation file: QLAB overview summer 2018

The QLAB core team led a workshop session to update QLAB participants on the latest developments with the project. The team presented a redesign for the next phases of the project, reflecting a perspective shift from crowdsourcing new or curated materials to adapting existing, validated materials with the multi-campus faculty team. Several lessons learned from the fall 2018 QLAB pilot were discussed. Participants engaged in brainstorming around the applicability of the problems in the validated online skill building modules “The Math You Need When You Need It” for Geosciences and Economics and “Math Bench” for Biology.  Discussion focused on the possible scope of each Qbit, and ways to engage faculty in appropriately framing the Q skill for use in their course(s). Read More

April 25: QLAB Information Session

Event: Information Session – Update on QLAB / What’s Next?
Location: ZOOM
Date: Wednesday, April 25
Time: 4:00 PM – 5:00 PM Eastern
Presenter: QLAB Core Team*

You are invited to join a webinar update and discussion about QLAB, the multi-campus collaboration to develop a shared framework for curating, implementing, and assessing online instructional modules to assist students with quantitative skills and reasoning across disciplines.

Read more about the pilot: https://lacol.net/qbits-pilot

Webinar Agenda: The goal of this session is to bring those who are interested up-to-speed with where the QLAB project stands, what we have learned so far, and what our next steps might be. Based on a new proposal developed by the core team over the winter and spring, the team welcomes your input on the next phases of the collaboration.

  • Status of the Q-bit project — overview of what’s been accomplished to date and the latest thinking toward the next phase of the collaboration.
  • Lessons learned so far
  • Seeking input on some next steps

Read More

QLAB / Q-bits Framework for Quantitative Skills Modules

To assist our students with readiness for their quantitative work across the curriculum, and to investigate the role that online resources may play in this, the Liberal Arts Collaborative for Digital Innovation (LACOL) has kicked off a multi-campus development and educational research initiative, nicknamed QLAB. The QLAB project provides a framework for creating a series of modules called Q-bits. Each online Q-bit module focuses on a particular quantitative skill or concepts and provides instructional and review content that is “wrapped” by pre/post knowledge and confidence checks, contextual guides, and applications problems in several disciplines. Read More

CHIANTI – Shared Grammar Resource

The Language Instruction Working Group is currently (Spring/Summer 2018) exploring an idea for a online resource built collaborative by/for LACOL faculty and instructors that will guide language learners on foundational grammar concepts.

There is an emerging plan for collaboration toward Shared Grammar Resources for Beginning Language Students. This concept has been discussed with enthusiasm in some earlier LACOL meetings, and Carleton Professor of Classics Chico Zimmerman has drafted a proposal to articulate more of the vision – see link above and below.

Four small teams are actively collaborating across several schools on the following module topics:

  • General Advice to Learners
    • General advice to incoming students about language-learning at college.
    • This includes some student voices on their learning experiences, but also could include some more general data/research findings on the benefits of L2 acquisition and the potential interferences of L1.
  • Map of Language Learning
    • An “overview” or map of the different domains that language takes in, including “grammar” broadly construed and its relevance
  • Glossary of Grammar Terms
    • A glossary of grammar terms with English examples; perhaps including sentence diagramming
  • Phonetics and Phonology
    • Phonetics/phonology module (perhaps with differing emphases depending on the target languages)

Read More

Language Skills Diagnostic Dashboard: 2018 Faculty Workshop and Pilot for French

C. Born, Carleton College, presents at ELI in Jan 2018
C. Born, Carleton College, presenting at ELI
Jan 2018

To advance the LACOL Language Skills Diagnostic Dashboard Framework, a three-day hands on-workshop will be held in spring 2018 at Swarthmore College, leading to a pilot study of the emerging prototype in French.  

The workshop and pilot are the next step in a sequence that began with the Language Skills Hack-a-thon at Swarthmore College in May 2017 and the Dashboard Prototype Technical Workshop at Carleton College in October 2017.  With groundwork laid at these previous events, the team is well positioned to put forward a working prototype in French that can be piloted with faculty and students for placement and advising in the summer/fall of 2018. Read More

Q-bits discussion at the Annual NNN Conference

In November 2017, Dr. Laura J. Muller, Director of Quantitative Skills Programs and Peer Support at Williams College and a member of the QLAB core team*, gave a presentation on the Q-bits Pilot to an audience of educators at the annual National Numeracy Network (NNN) Conference in New York.

Muller (pictured above right at the 2017 QS Hack-a-thon alongside Prof. A. Honig, Amherst College) has been at the forefront of Q-bits module design and implementation as part of a multi-year, multi-campus collaboration called QLAB. Given Laura’s teaching background and expertise in peer support and tutoring for Quantitative Skills and Reasoning, she’s interested in assessing the potential for online modules like Q-bits which can provide just-in-time support to help students brush up on, and apply, quantitative methods and concepts across the curriculum.

At NNN, Laura focused on issues of meta-cognition, student confidence, and transfer of QS/QR knowledge and skills across different context.

A distinguishing features of the Q-bits design is the opportunity for students to see that it’s worth investing time in learning certain foundational concepts that they will see over and over in their academic career.

Read More

QLAB update: piloting Q-bits with students (Fall ’17)

Prof. Ming An (Vassar College), lead author of the 'Choosing a Graph Type' Q-bit
Prof. Ming An (Vassar College), lead author of the ‘Choosing a Graph Type‘ Q-bit

starQLAB Webinar 11/15: 
click here to jo
in the discussion

 

This summer and fall, teams of faculty and technologists collaborated intensively to launch QLAB, a shared framework for curating, implementing and assessing online instructional modules for quantitative skills (QS) and reasoning for just-in-time review and skill-building across disciplines.  The goal of the QLAB project is to assist faculty teaching quantitative subjects who find they need methods to support students with gaps in preparation. The strategy draws on a body of research in higher education and experience at our institutions showing that online modules can be a beneficial component of an overall QS support program.

The individual modules, known as Qbits, review quantitative topics and demonstrate the topic’s applications in different disciplinary contexts.  For example, a module might review logarithms and then consider the application to decibels and sound perception in psychology, the Richter scale in geology, the concept of pH in chemistry, etc. In Fall 2017, Qbits are being implemented through a combination of videos and quizzing, and consist of an initial knowledge check, short videos to review specific quantitative skills, structured application problems that give students practice applying the quantitative skill in disciplinary contexts, and a final knowledge check.

Q-bits tested in Fall 2017:

project.
QLAB session
June 2017

Developing online resources that can be used in multiple contexts to help students strengthen their quantitative skills serves two purposes. First, by demonstrating the relevance of specific QS in various disciplinary contexts, students learn to view quantitative skills as fundamental and transferable skills that they can draw on in many areas of their liberal arts experience. Second, the consortial effort allows us to collect meaningful data about the effectiveness of the various modules for a greater number of students in a wider variety of contexts.  Using what we learn in this pilot, we plan to expand the collection of useful modules.

Aims of the pilot include:

  • Developing a collaborative framework for design, implement and assessment of online modules for QS/QR instruction and review at residential liberal arts institutions.
  • Crafting an initial set of instructional modules on high-priority QS topics, drawing on high quality instructional content, developed in partnership with Yale ONEXYS and others.  
  • Assessing module effectiveness as refreshers for tutoring and as just-in-time instruction embedded in coursework.
  • Gathering data to evaluate the impact of modules on student learning and confidence in each phase of the project and beyond.

Read More

Q-bit: Logarithms

LACOL_MKAlgebra:
Logarithms
Module Purpose: This module guides students on key concepts for working with logarithms in different disciplinary contexts.

Module Authors: Melissa Eblen-Zayas, Carleton College, Jim Rolf and Yale ONEXYS, with additional problems contributed by LACOL faculty, instructors and QS/QR tutors.

Notes on Strategy: 

  1. Watch the instructional videos to review some basic characteristics of logs and different ways that they can be used.
  2. Gain practice in applying your knowledge through problem solving.

Application Problems:

  • Perception of Sound (Psychology)
  • Acidity of Chemical Solutions (Chemistry)
  • Radioactive Materials – Rate of Decomposition (Chemistry, Physics)
  • Earthquakes and the Richter scale (Geology)
  • Binary Representation of Data (Computer Science)
  • Binary Search (Computer Science)
  • Doubling the Value of an Investment (Economics)
STUDENTS: Access the ‘Logarithms‘ Q-bit in your LMS! 

Carleton College: contact the Academic Technology team in ITS for access in Moodle.

Haverford College: https://moodle.haverford.edu/course/view.php?id=678

Williams College: contact the OIT team for access in GLOW.

Read More

Q-bit: Linear Functions

LACOL_MKAlgebra:
Linear Functions
Module Purpose: This module guides students on key concepts for working with linear functions in different disciplinary contexts.

Module Authors: Adam Honig, Amherst College, Jim Rolf and Yale ONEXYS, with additional problems contributed by LACOL faculty, instructors and QS/QR tutors.

Notes on Strategy: 

  1. Watch the instructional videos to review some basic characteristics of linear functions and different ways that they can be used.
  2. Gain practice in applying your knowledge through problem solving.

Application Problems:

  • The Keeling Curve
  • Moving Objects
  • Linear Functions in the Supply and Demand Model: Numerical Examples
  • Linear Functions in the Supply and Demand Model: Slopes and Intercepts
  • The Consumption Function
STUDENTS: Access the ‘Linear Functions‘ Q-bit in your LMS! 

Carleton College: contact the Academic Technology team in ITS for access in Moodle.

Haverford College: https://moodle.haverford.edu/course/view.php?id=646

Williams College: contact the OIT team for access in GLOW.

Q-bit: Choosing a Graph Type to Visualize Data

LACOL_MKGraphing:
Choosing a Graph Type to Visualize Data
Module Purpose: This module guides students on steps to think about the variables they’re exploring and select the best graph type to visualize them.

Module Authors: Ming-Wen An, Vassar College; Albert Y. Kim, Amherst College, with additional problems contributed by LACOL faculty, instructors and QS/QR tutors.

Notes on Strategy: 

  1. Watch the instructional videos and be wowed by the power of data visualization.
  2. Understand the importance of identifying the types of variables in your research question.
  3. Gain practice in selecting the graph type that is best suited to visualize your data.

Application Problems:

  • Biology: Personal Genomics – Quantifying Genetic Variation among Individuals
  • Economics: Discovering the Law of Supply and Demand
STUDENTS: Access the ‘Choosing a Graph Type’ Q-bit in your LMS! 

Carleton College: contact the Academic Technology team in ITS for access in Moodle.

Haverford College: https://moodle.haverford.edu/course/index.php?categoryid=44

Vassar College: http://moodle.vassar.edu/course/view.php?id=11931

Williams College: contact the OIT team for access in GLOW.

We welcome your feedback!! Please leave a comment below to let us know how this q-bit was helpful to you.  What would make it more helpful?  Do you have suggestions for other q-bits? 

[COMMENTS CURRENTLY CLOSED]

Professors present math/stats course sharing pilot at EDUCAUSE ELI

Faculty Talk: Where’s the Remote? Upper-Level Math/Stats Hybrid Course Sharing for the Liberal Arts
Presentation File: PDF
Date: Tuesday, January 30
Location: EDUCAUSE ELI 2018, New Orleans, LA
ProjectExplorations toward a LACOL course sharing framework

Prof. Hu, Vassar College
Prof. Hu presenting at ELI

As one possible avenue to expanding curricular offerings for math and stats majors at small liberal arts institutions, partner schools of LACOL have been exploring ways to remotely share classes using hybrid/online delivery modes.  Professors Steven J. Miller (Williams College, pictured above) and Jingchen Monika Hu (Vassar College, at left), two faculty members at the forefront of this collaboration, will describe their experiences in designing hybrid courses and teaching with a mix of digital pedagogies.  We will emphasize how connections were made between students and faculty, how well local and remote students were able to engage the material, and the various challenges in coordinating course delivery across several campuses.

For students of advanced mathematics and statistics, the liberal arts model offers a deep level of engagement in learning with faculty and peers; however, due to practical limitations, small colleges cannot always offer the breadth of course subjects available at larger institutions with graduate programs. To explore collaborative models that may help to enrich curricular offerings, faculty and technologists from several leading liberal arts colleges are experimenting with a consortial online/hybrid course sharing model.  In this talk, the professors will share results from three recent course pilots: Steven Miller’s Spring 2017 Problem Solving course from WIlliams College (involving students at Williams, Swarthmore and Amherst Colleges), Monika Hu’s Bayesian Statistics course from Vassar College, and Stephan Garcia’s Advanced Real Analysis course from Pomona College (Fall 2017).  
Read More

Nov 15: QLAB Webinar – Update on Q-bits Testing in Fall ’17 Pilot (+ What’s Next?)

M. Eblen-Zayas
M. Eblen-Zayas

Event: Webinar – Update on Q-bits Testing in the Fall 2017 Pilot / What’s Next?
Location: ZOOM (details below)
Date: Wednesday, November 15
Time:
12:00 noon – 1PM Eastern
Presenter: Prof. Melissa Eblen-Zayas & QLAB Core Team

 

You are invited to join a webinar update and discussion about QLAB, the multi-campus collaboration to develop a shared framework for curating, implementing and assessing online instructional modules to assist students with quantitative skills and reasoning across disciplines.

NB: A recording of the webinar will be shared for those who cannot join in person.

Read more about the pilot: https://lacol.net/qbits-pilot

Webinar Agenda: The goal of this session is to bring those who are interested up-to-speed with where the QLAB project stands, what we have learned so far, and what our next steps might be. We will be looking for input on approaches to revising the existing Q-bits, choosing topics for the next several Q-bits to be developed, and lowering barriers to contributing to the project.

    • Status of the Q-bit project — goals, what makes this project different, overview of what we have done
    • Lessons learned so far
    • Seeking input on some next steps

 

Course Sharing for Self-Instructional Language Learning (SILP)

Colleges within the consortium offer some form of guided, self-instruction of lesser-taught languages. In Fall 2017/Spring 2018, Vassar College and Williams College launched a collaborative exploration to share online, synchronous classroom-to-classroom interactions across their across their Self-Instructional Language Programs in Portuguese.  Through online web conferencing, the classes on each campus shared a tutor and teaching resources for students learning practicing their Portuguese pronunciation and conversation skills. 

Learning Design:

  • Two one-hour synchronous sessions each week with all students and the tutors
  • Up to ten hours of independent study in preparation for the tutorial sessions

Students enrolled in a Self-Instructional Language Course meet twice a week with their tutor and other students in the course. Each student is expected to prepare thoroughly for these sessions, using detailed study guides, a textbook, and multimedia materials. The focus in SILP lies on communication, not on grammatical analysis and literary study. Hence tutorial sessions are conceived as review sessions, unlike more traditional language instruction where new material is often introduced during class.

The tutor’s role is to facilitate the active use of words and structures learned by students beforehand, and to model the use and pronunciation of the language. A shared course differs from a regular course in SILP only in the addition of remote learners to the host institution’s class. All students and the tutor interact with each other in real time via videoconferencing technology. In addition, tutorial sessions are recorded and may be used for further review.

– Project lead L. Gerhardi (Vassar College)

Related Posts:

Upper Level Math & Stats Course Exchange

As one possible avenue to expanding curricular offerings for math and stats majors, partner schools of LACOL have been exploring ways to remotely share classes using hybrid/online delivery modes.

Math/Stats Pilots: In Spring and Fall of 2017, several LACOL colleges collaborated to pilot three shared course offerings for advanced mathematics and statistics:

  • Putnam Problem Solving, Spring ‘17 (Prof. S. Miller, WIlliams College)
  • Advanced Real Analysis, Fall ‘17 (Prof. S. Garcia, Pomona College)
  • Bayesian Statistics, Fall ‘17 (Prof. M. Hu, Vassar College)

The goal of this exploration is increase the wealth and frequency of the advanced classes our students need, both for graduate study and to delve deeply in the subject.

Learning Design: For these shared courses, each professor opened their course to students across LACOL, sharing lectures, assignments and other class activities through both asynchronous (e.g. recorded lectures and screencasts) and synchronous (e. g. online problem solving sessions and office hours) means.

In these pilots, students reported positive experiences and some adjustments to learning through digital modes:

Before I took Professor Miller’s class, I was already very interested in problem-solving and participating in math competitions […] I was really excited to hear that there was a professor at Williams who was teaching a class on Putnam. I wanted to improve my problem solving skills systematically. The biggest advantage was that I could watch the videos whenever I wanted, and take classes that I otherwise could not fit in my schedule at Swarthmore. I also watched Professor Miller’s other videos, including the ones on number theory or complex analysis, to fill in gaps of my knowledge.
– John Fan, Swarthmore ’19

Read More

Language Skills Dashboard – drill down on data visualization

UPDATE: Join Carly Born for her Dashboard Poster Presentation at ELI this January

As a sequel to last summer’s Hack-a-thon Toward a Collaborative Language Diagnostics and Refresher Framework at Swarthmore College, a dedicated group of language learning technologists and Carleton’s student “Data Squad” gathered this fall at Carleton College to work on platform requirements for a dashboard prototype.  Led by Michael Jones  and Carly Born, this two-day mini-hack-a-thon focused on solving technical pieces of the puzzle that will enable the flow of useful data from a language skills diagnostic test into a data-rich visual display. 

LI Framwork banner

The dashboard is just one piece our faculty’s vision for the shared framework drafted at the meeting last May. Elements include a language skill map, a self-assessment survey, diagnostic/placement tests (question banks) and the dashboard that can help faculty visualize the data for better placement and advising.

Language Learning Skills Map / Top Level Categories:

  • Grammar
  • Comprehension
  • Discourse
  • Vocabulary

Diagnostic visualizations also may point to trends in language skills development within and across our liberal arts programs and language curricula.  A user-friendly dashboard tool can ultimately help students gain feedback on their skill levels and close gaps as they traverse the liberal arts language sequence. Read More