You are here

Flipping a Class, the Learn by Doing Method

Author(s): 

Steven Slezak, California Polytechnic State University

05/23/14 to 05/29/14
Abstract: 

Two major advantages of the flipped classroom format are that it allows for greater flexibility in the use of class time and it enhances the quality and quantity of one-on-one teaching encounters between faculty and students. There are as many varieties of the flipped format as there are educators using it, so experience varies from classroom to classroom. What is important is that the format should emphasize active learning on the part of the students, empowering them to take responsibility for the learning process. The teacher’s role becomes one of facilitator or coach. In my experience, the flipped classroom method combines lecture videos which students view before coming to class with class time reserved for problem-solving exercises, Just-in-Time teaching utilizing reading forums and customized teacher feedback, Peer Learning, case work and discussions, writing exercises, and performing online exercises and research. As a result, class time is better structured, and I can address special concerns and weaknesses expressed by individual students about the material. I have more interaction with individual students during class and can provide one-on-one instruction in short bursts to students hung up on a particular problem or application. Interaction with students provides feedback, so I can perform real-time assessments of student skill levels and mastery of the material, and I can adjust the curriculum and the pace of the class accordingly. Students also benefit from the ability to watch lectures on their own time, pausing the recording to work on lecture problems, and repeat difficult sections for better understanding. The major disadvantages of the flipped classroom format are student pushback and resistance to active learning methods, the amount of prep work that must be done to produce video lectures and to prepare assignments for each class session, the need for quick turnaround of in-class assignments for student assessment purposes, and the lack of quality support available to educators who wish to employ the approach.

Paper: 

Introduction

“Jesuits learn best by teaching others.”

− Father Juan Polanco, SJ (1517-1576)[1]

What’s true of the Jesuits is true of all teachers, and their students.  Learning by teaching others is the heart of the flipped learning (or inverted classroom) method.

A useful definition of “flipped learning” has been developed by the Flipped Learning Network (FLN):

Flipped learning is a pedagogical approach in which direct instruction moves from the group learning space to the individual learning space, and the resulting group space is transformed into a dynamic, interactive learning environment where the educator guides students as they apply concepts and engage creatively in the subject matter.[2]

The essence of the flipped classroom is the transformation of the relationship between the educator and the students.  Flipped learning is a student centered model.  In a traditional classroom, the educator is the active agent in the process – the teacher lectures and provides information to the class.  Students largely play a passive role, listening, absorbing information, and taking notes.  Students become active in the traditional learning process by asking questions or participating in discussions, but by and large they are sponges soaking up information.

Outside of class, students complete readings and homework assignments, away from their teacher.  In the traditional classroom method, the onus for the transmission of information is from the active educator to the relatively passive student.

Under the flipped classroom method, the onus for active learning is placed on the student.  Students use class time to practice lessons they have learned outside of class, applying lessons gained through assigned readings and video lectures.  In class, students solve problems, analyze cases, and work on projects. 

In the flipped classroom, the role of the educator is not passive, but it is transformed into one of learning management.  In class, the teacher becomes a coach or facilitator of learning, guiding the students through the solution of problems and the preparation of analyses.  The teacher is freed up from conveying information through lectures and can employ different learning modes, depending on the students’ needs for that day.  Teachers can provide one-on-one instruction to individual or small groups of students and give real-time feedback, assessment, and support. They can tailor instruction to the particular student’s level of mastery of the material, or to the specific aspects of the problem causing students the most trouble.

 

Six Lessons Learned by Doing

My experience with flipped learning has not been as neat and clean as the previous paragraphs might suggest.  There was very little guidance available, either at my institution (Cal Poly) or from online sources.  I was familiar with the concept and found it appealing, but the practice proved difficult to implement.  Our University President calls Learn by Doing “the cornerstone of the educational approach” at Cal Poly[3].  True to our motto, that is how I developed my own approach to flipped learning.  From my perspective, each educator needs to create his or her own version of flipped learning, choosing from the many best practices now available those which are most appropriate to each educator’s situation and goals.

To be sure, there are common elements that characterize all flipped learning approaches.  The FLN proposes The Four Pillars of F-L-I-P as a starting point[4]:

F – Flexible Environment
L – Learning Culture
I – Intentional Content
P – Professional Educator

Unfortunately, my experience began with a different set of (crumbling) pillars, from which lessons can be drawn.  I learned that an “all or nothing approach” was not a good starting point because its underlying assumption of “What can possibly go wrong?” was invalid.  I failed to communicate the concept well to students.  I did not properly organize in-class projects and activities and failed to realize my role as facilitator and coach.  I mistakenly assumed students would do the necessary readings and video assignments in preparation for class without incentivizing them to do so.  I also failed to anticipate and prepare for significant student pushback.

In the three years I have been working with these tools, I have been able to expand their use from one course to three.  Another professor in my department has also adopted the flipped method and uses the materials I developed.  I use the inverted classroom to teach college juniors and seniors material in finance and strategy, but the methods were developed by Professor Eric Mazur at Harvard to teach science courses.  The approach is broad enough to adapt to any curriculum without much trouble, but it is well-suited for the sciences.

 

Here are some of my early lessons learned. 

  1. Communicate the Concept

Student acceptance of your efforts to transform the classroom environment is central to your ability to succeed.  Keeping students informed of what is happening and how it benefits them is essential to helping them become comfortable with the changes you are bringing to their education.  Without sufficient communication between you and your students, resistance to your efforts will develop.  It can become quite strong.  Clear communication is more preferable than managing student pushback.

Your syllabus is the first place to share information with students.  This assumes students read the syllabus in the first place, but it puts the educator on record about his or her intentions from the very beginning.  At the first class meeting, the educator needs to emphasize the changed structure of the class and explain the direction he or she will be taking.  Having a good description in the syllabus will help the teacher establish the rules and expectations for the new classroom format, and will aid in managing student expectations later in the term. 


Here is how I introduce the idea in the syllabus:

A Comment on Learning:  Learning any subject matter is not simply the acquisition and accumulation of facts, or the regurgitation by the student of correct information. Learning involves the assimilation of facts into new information and integrating new information with your own knowledge and experiences. The student is learning when he or she can take something from one context and apply it in a different, unfamiliar context. The delivery or transfer of information by the instructor to the student is not sufficient to help the student learn or understand the material. Students must take an active role in the learning process.

In this course, active learning opportunities will be provided, requiring the student to engage directly in learning. The lessons for each class meeting are designed by the instructor on the assumption that the assigned readings from the textbook, video lectures, and lecture notes will be completed by the student before class. If students prepare for class by reading the assigned texts and course notes, and letting the instructor know what parts they find most difficult, then we can use class time to work together to develop a deeper understanding of the material.

We cannot discuss all materials in class; still, students are responsible for mastering the necessary materials in order to reach the learning outcomes stated in the syllabus. This requires the student to engage an active learning approach in this class.

 

Who knows?  Discussing your expectations and their responsibilities might even entice students to read the syllabus through.

In laying out your new approach, it is very important not to characterize your effort as “flipping” or “student centered learning.”  If students have heard about flipped learning, it has most likely been through the student grapevine and campus rumor mill.  They will not have an accurate understanding of the pedagogy behind your approach and they are likely to take a closed-minded attitude from the start.  If so, you will have an uphill battle from the first day. 

Some students will be curious and willing to work with you, but the majority will be very skeptical.  They will not want the onus of their learning to be placed on their shoulders.  It sounds like too much work and they will respond as though you are lightening your teaching load by burdening them with more to do.  So avoid referring to the new system as a “flipped classroom.”

A better approach is to emphasize the important benefit students will derive from this new method.   Very few of them will grasp the benefits at the beginning, and many will not see it that way at all.  So the teacher must spell out the advantages students are going to experience.  It doesn’t hurt to continue showing students the benefits during each class period.  Sometimes it needs to be done with each lesson.

It is also helpful to emphasize to students the importance of preparing for each day’s activities before they come to class.  They will not do well with the in class work if they have not done the advance reading and watched the video lectures before stepping foot in class.  Do not emphasize the changed format.  Instead, let the students know you expect them to prepare themselves to get the most value from the in-class activities.

You want to develop a routine for the students.  If you repeatedly inform them they could feel lost or fall behind if they are not prepared they will eventually get the message.  It is also helpful to give students plenty of lead time on what to expect in the next class, and lay out what work they need to accomplish to be ready for the activities you have planned for them.  If they can see what is coming down the road and what they have to prepare for ahead of time, you will have less difficulty establishing a routine for them to follow.  A routine helps you achieve student buy-in.

 

The ASCD (formerly the Association for Supervision and Curriculum Development) laid out five benefits in 2013.[5]  My experience in the last three years is consistent with the ASCD position:

  1. Improved Student-Teacher Interaction
  2. Real-Time Feedback
  3. Student Engagement
  4. Self-Paced Learning
  5. More Meaningful Homework

In communicating the concept, you will find yourself teaching students how to take advantage of the new materials you have prepared and how to better manage their time.  From my perspective, the benefits most appealing to students are self-paced learning, real-time feedback, and the ability to work on real-life problems and projects during class time under supervision of the teacher.  If the instructor places emphasis on these valuable features, students are likely to respond with some interest and measured enthusiasm.

 

2.         Think Through Classroom Projects and Activities

A major mistake I made during early efforts to invert the learning experience was not preparing enough for in-class activities and projects.  I didn’t have sufficient numbers of activities available when I started, and I didn’t think through how to use them to manage class time and the learning experience.  As a result, students thought my approach the first time was ad hoc and improvised, which generated resistance.

The active learning approach is likely quite different from what most students experienced in high school and in previous college classes.  It is important for the students and their teacher to realize that active learning begins for both before class meets.  The educator must make an effort to get feedback from students before each class session so the educator can begin to tailor the day’s lesson to the specific needs of the class.  It is difficult to prepare appropriate in-class problems or assignments without understanding how far student mastery of the material has developed.

Before each class, you need to require students demonstrate they have done the readings, watched the video lectures, and are in general prepared for the problems they will work that day.  I did not understand well at the beginning that I needed to help students prepare for each class by making sure they knew what subjects and materials they would cover in the next class, by letting them know how they needed to prepare, and by giving them some idea what they are expected to accomplish.  I found if I asked them to prepare but did not let them know what they were preparing for, they were less likely to apply themselves beforehand. 

 

One solution for this problem is Just-in-Time Teaching (JiTT). 

Basically, the idea behind JiTT is to require students to communicate to the teacher before class their level of preparation for the day’s lesson.  The George Washington University says that “pre-planning is the key to JiTT success.”[6]

There are various ways to do this, but I chose to ask them questions about the reading and video lectures in an online forum.  Students are required to respond by a deadline before class so I can read and grade their comments.  Using this information, I can craft the day’s lesson to fit the dominant themes in their comments – their questions, topics that are unclear, difficulties they encounter, and so on.  I design a short, to-the-point lecture to address their concerns and then assign work that will help them overcome their difficulties.  This class work is also graded. 

Student feedback is useful to the teacher, who can use the information to shape the day’s lesson plan to suit the specific needs of the students at that time.  In a way, the lesson plan is prepared by the students themselves.  Armed with this information, I have never been at a loss regarding what needs to be done during the next class session.  So the day’s work begins with the students’ brief pre-class comments and ends with an extended application of the lesson.  Both activities are graded to motivate students to get the work done.

 

3.         Give Students More Information Than They Can Handle

It took me a couple months to appreciate what an information hog the flipped learning format can be.  Students provide more information in their regular feedback than a teacher can process.  Fortunately, the educator can select the most useful feedback for lesson planning purposes.  Information that isn’t used to design the day’s lesson plan can be addressed by other methods – posting articles on class blogs, answering questions in e-mail blasts to the class, asking students to drop by during office hours to discuss their thoughts, filing away for later reference, or ignoring it.

Realize that the information flow is two-way; it is important for the educator to provide students more information than they can process.  This is not difficult to do given the numerous sources of quality information technology available for classroom use these days – drop boxes, blogs, Blackboard, Moodle, Twitter, eTexts, online learning systems (such as those available from Aplia and Pearson MyLabs), YouTube, Tumblr, RSS feeds, and the list goes on.

Flooding students with information might sound counterproductive, but in fact the educator can use the flood to better prepare the class.  At first, I was a bit reluctant to expose students to more information than I thought they could handle, but what I found out was marvelous – students began to engage with me to discuss what information was useful and how they were to incorporate it into their learning methods.  They began asking for help in organizing and structuring their knowledge, in other words.  And what is a teacher for?

When faced with the prospect of drowning in information, rational students decide they need to find a way to sort through it, figure out what is useful and what is not, and begin putting it to good use.  They actively manipulate the information and extract meaning from it.  At the same time, and I did not at first anticipate this, they realize they were not prepared for this task by their previous education experiences in high school and college, so they seek out assistance from first their peers, and then from their instructor. 

At this point, I realized the students needed me to facilitate and supervise this process for them.  They want to get it right and their teacher becomes the best resource available.  The teacher is now in the position of providing real-time feedback to the students’ efforts and assessing on the spot the level of student understanding.

Recall that the role of the educator in the inverted classroom system transforms into that of a facilitator or coach.  This method of information overload turns out to be a useful agent for this transformation, in my experience.

I found the university library a great place to start.  At Cal Poly, librarians will set up a research portal for individual classes[7] and include on the site every conceivable online resource for students to access.  A JiTT assignment asking students to visit a library research guide, select two or three online sources, and catalog what can be found there serves as an introduction to the depth of information available to students and gets them started on the task of structuring and organizing their knowledge.

 

4.         Get Students Prepared

Two pedagogical methods boost the effectiveness of the flipped learning method:  Just-in-Time Teaching and Peer Instruction.  These methods excel in preparing students for in class learning.

 

The George Washington University describes JiTT as:

promot(ing) active student engagement and increased learning by intentionally linking out-of-class and in-class activities. Before each class meeting, students answer a small set of web-based questions on upcoming course material outside of class and submit their responses online a few hours before class begins. Once submitted, the instructor reviews the students' JiTT responses and develops in-class active-learning exercises targeting students working learning gaps identified in the JiTT responses – ‘just in time’ for class.[8]

 

A leading proponent of Peer Instruction is Eric Mazur, a professor of Physics at Harvard University.  In a 2001 study he co-authored, the Peer Instruction method is described as “engag(ing) students during class through activities that require each student to apply the core concepts being presented, and then to explain those concepts to their fellow students.”  The study credited Peer Instruction with “increased student mastery of both conceptual reasoning and quantitative problem solving.”[9]

 

Separately, JiTT and PI are effective methods for improving student performance and learning.  In combination, they can be powerful, especially in the hands of an experienced instructor practicing within the context of the flipped learning format.

Before I began working with the inverted classroom approach, a major concern was how to motivate students to do the assigned readings and spend time viewing lectures on YouTube before coming to class.  The student preparation problem seemed particularly vexing and no easy solution suggested itself.  It was obvious that without adequate preparation before class time, students would not be positioned to take advantage of in-class work built upon the lessons from the readings and lectures.  Motivating students in this area is critical.

One way to implement JiTT and PI in combination, used by Ives Araujo, a professor at the Federal University of Rio Grande do Sul in Brazil, is illustrated below.[10]  JiTT is use to prepare students before class and PI is employed in class to build on student preparations.

Professor Araujo’s study shows that 80% of his students did each pre-class reading assignment, and that “90% of the students’ submitted answers demonstrated engagement, for example through a justification for a submitted answer, discussion of the content they found difficult, or discussion of the content they found motivating.”[11]

As with much of flipped learning, there are many different, but equally effective, ways to implement JiTT and PI.  It is important that educators determine what works best for them in their particular circumstances and in the context of their particular courses.  In general, it is important to give considerable thought to the where, when, how, and why of JiTT and PI.

In terms of JiTT, it is necessary to develop a good set of questions to ask students before class, in order to elicit from them valuable and revealing feedback the instructor can use to design the lesson for the day.  The questions need not be sophisticated.  Professor Araujo asks his students, “Did you find anything difficult or confusing in the reading? Which parts? If you didn’t find anything difficult or confusing, describe what did you find most interesting in the reading. Do you have any questions?”[12]

I ask similar questions to get broad and general answers one day, then follow up the next day with very specific questions to which students must give a precise numerical answer or indicate the correct answer for a multiple choice question.  I also ask students to choose an incorrect answer and explain to me why they think it is wrong.  The point is to link the pre-class questions and responses with the in-class projects in such a way the students see the connection and come to expect it routinely.

When students realize they are graded for the quality of their answers, and make the connection between the JiTT reading before class and the in-class graded PI activity, their motivation to prepare becomes more apparent.

The JiTT pre-class responses can also be used by the instructor to shape the PI exercise in class.  The teacher will know from the responses which students understand the material better than others, and can use this information to form student groups in which knowledgeable students are placed among their less advanced peers.  These groups can then begin to discuss and solve problems in class, during which discussions the more knowledgeable students will share what they know with their peers.

Soon, the students themselves understand who knows what; they begin to form groups around those students the others consider well-informed.  These knowledge leaders share what they know with the others, and students start learning from each other.  Peer Instruction sometimes appears almost a spontaneous event, one that is very rewarding for the educator to watch blossom in the classroom.

 

5.         Manage Student Expectations

Regardless of how well you have laid out the transition to the flipped learning format, or how thoroughly you might integrate JiTT and PI activities, managing your students’ expectations is key to the success of your efforts.  Under the best of circumstances, student pushback can be significant.  Educators cannot allow student resistance to undermine progress or sap confidence.  If students know what to expect, the transition will go as smoothly as possible.  Students don’t like surprises.

 

Catherine H. Crouch and Eric Mazur wrote in 2001, “It has been established that students often require a period of adjustment to new methods of instruction before their learning improves.”[13]

Some degree of student pushback is inevitable so it is best to prepare for it.  A proactive approach will serve you better than a reactive position.  Otherwise, when resistance arises you risk becoming distracted.

It is natural for students to be confused and uncomfortable as their classroom environment transitions away from the methods they are used to towards something that requires them to become more accountable for their own education.  This concerned me when I first encountered it, but I quickly realized the root cause of their discomfort was the fact that they were actively learning. 

I tell each class now that the queasy feeling they have in their stomachs is what learning is all about.  It is a manifestation of the “Learn by Doing” method, which to my way of thinking is indistinguishable from trial and error.  Trial and error in the classroom necessarily involves unfamiliar forms of teacher-student interaction and requires students to make mistakes and learn from them.  They must become comfortable with the feeling that failure on an assignment does not mean disaster for them.  Instead, students must become comfortable with controlled failure and see it as the gateway to successful learning.

It is essential that the instructor do two things to ride out any early doubts or misgivings that may arise about the efficacy of what he or she is trying to do.  First, keep the focus of active learning on the students and don’t let them push accountability for their education back on you, their teacher.  Second, stay the course and let the “Aha!” moments happen on their own schedule. 

Not every student will have an “Aha!” moment, the point at which they realize the satisfaction of understanding what they are doing.  But it’s not necessary that each student experience a small epiphany for learning to happen.  As the instructor keeps pushing forward with the transition to flipped learning, the “Aha!” moments start to occur.  When they do, the instructor has to be sure to point those moments out to the class as a whole.  Take some time to let students know that learning is going on.  Celebrate student progress as they make it and link their growing mastery of the subject to their pre-class preparation and the in-class work they are doing.  This is how student buy-in begins.

 

Students should sense their instructor is leading them through the changes and will be there to provide needed guidance and support when they stumble and get things wrong.  The Center for Teaching and Learning at the University of Texas cites many good ideas for “creat(ing) a positive climate/community for learning where students feel supported.”[14]  This sense decreases the anxiety that drives student resistance and pushback, and helps students accept the flipped learning method.  It helps accelerate the arrival of the inevitable “Aha!” moments, in my experience. 

 

Until then, prepare to manage any pushback intelligently and without taking student criticisms personally.

This can sometimes be hard to do.  My first attempt at flipped learning led some students to comment negatively on the approach.  One student expressed the opinion on a course review form that “a monkey” could do my job.  Another stated that students “pay too much” tuition to be expected to “teach themselves.”  Yet another expressed a desire “to flip the bird” at the professor’s class flipping ambitions.

It helps to remember that, in the learning process, the “Aha!” moment is preceded by resistance and pushback.  If the instructor provides support and guidance for students as they acclimate to the active learning process, resistance can be managed or even minimized and the inevitable arrival of the “Aha!” moment is hastened along.  Support and guidance takes the form of communicating the concept, thinking the process through (especially the in-class assignments), providing lots of information for students to process, and getting students prepared through the implementation of JiTT and PI. 

Above all, resist the temptation to negotiate with students over your teaching methods.  Listen politely as they criticize your methods and complain how they “learn better” under the “talk and chalk” method.  Answer their questions in a straightforward manner without any prevarication. 

Let them gripe to their friends, let them pan you in their teacher evaluation forms and on teacher ratings blogs, but make them sweat the trial and error in class.  Do not enter into negotiations with students about how you should be implementing the flipped learning process or debate with them whether it is a good idea at all.

Hold them accountable for their new role and let students know you are looking forward to their meeting your expectations.  You cannot win a negotiation with them so it is best not to give any indication you are willing to sit down and talk it out.  Hold your ground and you will eventually see students warming up to the new approach just as you have.

It is important to remember you are probably not the only instructor on campus working in the new format.  It is likely one or more students in your class already have experience with active learning methods.  During the worst of the pushback I encountered at the beginning, one or two students let me know privately that they had already been through a flipped class under other instructors and that they were familiar with what I was trying to do.  This was a relief to learn and helped me hold out against the tide of criticism.  And this, like all tides, will flow before it ebbs.

 

6.         Peer Instruction is Your Friend

Peer instruction is an effective pedagogical method.  As Cassandre Alvarado, Assistant Dean for Undergraduate Studies at the University of Texas stated, “PI helps students engage in the higher order thinking skills of metacognition and related activities, such as self-monitoring and self-regulation that are essential to succeed at the college-level and beyond.”[15]

But PI is also a key to getting student buy-in to your active learning approach.  Students learning from other students accelerates the buy-in process.  Students who understand the material well enough to lead other students in Peer Instruction demonstrate to the most reluctant among them how to make the inverted classroom work.  This is a powerful example for students to witness. 

Subtle peer pressure combines with the self-monitoring and self-regulation and learning begins to spread among the class peer group.  It is one thing for the teacher to demonstrate a method to a class but quite another for one student to work it out then lead others in the lesson.  Students see their peers’ growing mastery of the subject matter and develop a keen interest in not being left behind.  It is peer pressure at its best.

To borrow a phrase, “Students learn best by teaching others.”

 

Conclusion

In my experience, the flipped classroom method combines lecture videos which students view before coming to class with class time reserved for problem-solving exercises, Just-in-Time Teaching utilizing reading forums and customized teacher feedback, Peer Instruction, case work and discussions, writing exercises, and performing online exercises and research. 

As a result, class time is better structured, and the teacher can address special concerns and weaknesses expressed by individual students about the material.  The teacher has more interaction with individual students during class and can provide one-on-one instruction in short bursts to students hung up on a particular problem or application.  Interaction with students provides feedback, so the teacher can perform real-time assessments of student skill levels and mastery of the material and can adjust the curriculum and the pace of the class accordingly.  

Students also benefit from the ability to watch video lectures on their own time, pausing the recording to work on lecture problems, and repeat difficult sections for better understanding. 

The major disadvantages of the flipped classroom format are student pushback and resistance to active learning methods, the amount of prep work that must be done to produce video lectures and to prepare assignments for each class session, the need for quick turnaround of in-class assignments for student assessment purposes, and the lack of quality support available to educators who wish to employ the approach.

 




[1] O’Malley, John W.  “The First Jesuits.”  Harvard University Press, 1995.

[2] Flipped Learning Network (FLN).  (2014) The Four Pillars of F-L-I-P™.  Web.  Accessed 4 February 2014.  http://www.flippedlearning.org/definition

[3] Armstrong, Jeffrey D.  “Opening Remarks from Cal Poly President Jeffrey D. Armstrong.”  Cal Poly, February 2011.  Web.  Accessed 23 April 2014.  http://www.calpolynews.calpoly.edu/news_releases/2011/February/Armstrong-quotes.html

[4] FLN, op. cit.

[5] ASCD.  “Research Says Evidence on Flipped Classrooms is Still Coming In.”  Educational Leadership, March 2013.  Web.  Accessed 8 April 2014.  http://www.ascd.org/publications/educational-leadership/mar13/vol70/num06/Evidence-on-Flipped-Classrooms-Is-Still-Coming-In.aspx

[6] Teaching and Learning Collaborative.  “Just in Time Teaching:  Steps 1 – 4.”  The George Washington University.  Web.  Accessed 4 April 2014.  http://tlc.provost.gwu.edu/just-time-teaching-steps-1-4

[7] Robert E. Kennedy Library.  “Cal Poly Research Guides.”  Cal Poly.  Web.  Accessed 4 April 2014.  http://libguides.calpoly.edu/home

[8] Teaching and Learning Collaborative.  “Just in Time Teaching and More.”  The George Washington University.  Web.  Accessed 4 April 2014.  http://tlc.provost.gwu.edu/just-time-teaching-more

[9] Crouch, Catherine H. and Eric Mazur.  “Peer Instruction:  Ten Years of Experience and Results.”  American Journal of Physics, September 2001.  Web.  Accessed 1 April 2014.  http://research.pomona.edu/kevin-sea/files/2013/07/MazurActiveLearning.pdf

[10]Schell, Julie.  “How One Professor Motivated Students to Read Before a Flipped Class, and Measured Their Effort.”  Turn to Your Neighbor, 4 September 2012.  Web.  Accessed 15 April 2014.  http://blog.peerinstruction.net/2012/09/04/how-one-professor-motivated-students-to-read-before-a-flipped-class-and-measured-their-effort/

[11] Ibid.

[12] Ibid.

[13] Crouch and Mazur, op. cit.

[14] Center for Teaching and Learning.  “How Can I Motivate Students to Engage in Class?”  University of Texas.  Web.  Accessed 18 April 2014.  https://ctl.utexas.edu/teaching/engagement/motivate_students

[15] Schell, Julie.  “How Can We Improve Student Learning in the State of Texas?”  How to Transform Learning – with Teaching.  Leaders of Learners, June 2012.  Texas ASCD.  Web.  Accessed 8 April 2014.  http://assets.pearsonschool.com/asset_mgr/current/201331/Rep_690.pdf

 

Comments

Steven,
Thanks for sharing your experiences with implementing a flipped classroom. I'm curious about how you grade student posts to the discussion forum, since they are discussing ideas they have not yet encountered in class. Are their posts evaluated for correctness?
Jennifer

Hi Jennifer:

I provide the students a rubric on what I am looking for in their forum posts. They haven't had a class session on the material yet, but by the time they join the forum they should have watched the lecture videos online and completed the assigned readings. So they aren't coming into the situation cold.

Remember, typically the first forum they see is a broad, open-ended question about what they don't understand or find confusing from the video and readings. The second forum is typically a selection of representative multiple-choice questions designed to assess more specific learning objectives. By the time they see the second forum they have completed problems in one or two classes with me.

There are several pre-reqs for my classes (they are 300 and 400 level) so I am also looking to see what they have retained from earlier coursework. That is referred to in the rubric.

Here is the rubric I use for one of my classes:

50% – Student does not submit a forum response.
50% to 60% – Student does not know how to answer the question.
60% to 70% – Student tries to answer the question but does not show evidence of any previous knowledge to assist in answering. Student may reveal misconceptions about concepts. Student does not use any information from the text, or lecture notes, or other sources to answer the question. (Incorrect answer).
70% to 80% – Student shows some prior knowledge and may use terminology to answer the question. Student does not use appropriate information from the text or lecture notes to answer the question. (May be partially correct but still incomplete).
80% to 90% – Student shows some prior knowledge and may use terminology to answer the Warm Up question. Student uses appropriate information from the text or lecture notes to answer the question but does not manage to provide a correct or complete answer. (May be partially correct but still incomplete).
90% to 100% – Student answers the question correctly and completely. Student incorporates information from the text or class notes into the answer. Student may look for answer outside the class (other texts, web, news articles, etc.). Student applies information from one context to a new and unfamiliar context. Student correctly cites and references outside sources.

Steven

Hi Steven,

Thanks for a great overview of the flipped model and how you struggled and succeeded in implementing. I'm sure most of us who have flipped were smiling and nodding when reading your paper. I have a couple quick questions:

Can you briefly describe the courses you use this in? Since most of us are chemistry related educators, it would be helpful to know what type of classes and types of students you have had success with given your background in the Agribusiness Department at Cal Poly.

You mention creating "to-the-point lectures" for students after reading online forums. Is this a mini-lecture that you use class time (if so, how much) for or is it a quick video/tutorial that you make that is available before class?

Also, you talk about "overloading" them with information. Like you, I'm on the fence with this issue given the possibility of cognitive overload creating student disengagement. Could you share a little more on how much information you mean by overloading? Are you talking about 3-4 external links to websites,texts, etc. that are covering the same material or is the overload based on "cool to know" facts?

Thanks!

Chris

Steven,

Thank you for the excellent overview of the flipped classroom. I have just completed my first year teaching organic chemistry with JiTT and the flipped model and your observations have helped to crystallize my own in many ways. I definitely agree that it is important to explain what the pedagogy will be and why from the outset. I like the idea of drawing attention to "aha" moments, but have a poor imagination in that regard. Could you share a few specific examples?

You also comment that we should "resist the temptation to negotiate with students over your teaching methods". I agree to an extent, but have also found conversations with students about how to improve valuable both in terms of their attitudes and ideas. I ask my students to complete a survey and then spend class time reviewing the results after the first exam and at midterms. I state clearly that the purpose of the survey is to gather ideas for how to improve the pedagogy, not whether to continue it. These exercises have produced some good ideas that I have been able to implement and are regularly commented upon favorably in my teaching evaluations.

I did a mid-semester survey for my flipped class this spring but rather than discuss it in class, I would copy and paste comments to a discussion on piazza and respond to them there. A few posts were made following that but they did get a lot of views so hopefully it reached some of them.

Chris:

Thanks for the questions.

I used the inverted format in three classes: introductory finance, intermediate finance, and strategy formulation. The classes vary in size from 15 to 60. They are usually taught in a lecture format, but I have the students work mostly during class time on solving problems -- they are calculation problems exclusively so they need to bring a laptop to class to work their solutions in spreadsheets, which they upload to a dropbox for grading. I got the idea from Eric Mazur at Harvard, who teaches physics in a lecture format (that is, no labs), so I know it can be used in the physical sciences.

My "to-the-point lectures" are part of the Just in Time Teaching method. I read student responses to the reading forum questions and do a quick assessment to see what the students need to learn in the next class period. I do this a couple hours before class meets. My classes meet for two hours twice a week, so I try to use less than the first hour to respond to student questions or misunderstandings I pick up from their comments. That is the "to-the-point lecture." If I prepare it well, I can usually keep it to about 30 to 45 minutes, which allows plenty of time for the problem-solving portion of class.

During the problem-solving portion, I work with students one-on-one or in small groups (I allow them to organize themselves into study groups) to help them get over difficulties they are having with the in-class assignment. If I see the same difficulty popping up among different student groups, I might take ten minutes to explain the concept or exercise again.

As for information content, I have a pretty good idea what information a student need to do really well in the class, and I know most students do not bother reaching that information level. Most are trying to figure out what is the minimum they need to know to accomplish whatever their goals for the course are. I tell them they will get roughly 20% of what they need to know from the video lectures and the in-class lectures -- the rest will come from reading the text and working problems in class.

I also tell them that the problem is not insufficient information available for them to learn from. The problem they need to address is the overabundance of information available these days, much of which is useless, which they need to sift through to find the really valuable nuggets. I tell them they need to develop their information gathering and organization skills if they are to makes sense of what is out there.

So I emphasize the importance of reading the text and their going through the videos more than once. For many, that alone represents information overload. I also do not hesitate to post additional (but optional) readings from articles and journals I find. These posts illustrate the real-life applications of the lessons we are learning in class. These might be links to news articles, or PDFs of academic studies, or posts from other blogs, or YouTube videos. I can tell who is going further in their study because they refer to these in their reading forum posts. They also come to talk about how to make sense of things.

I don't know if I answered your questions. I guess I am saying it is contextual.

Hi Justin:

The "aha!" moments make it all worthwhile. The class might be broken into groups and students are working together to solve one of the assigned in-class problems. They are all calculation problems, so students bring laptops to work out solutions in Excel. I can tell which groups are struggling with things because they are all checking each other's work and asking questions of each other but nobody seems to be getting a solution. Such groups are generally quiet, as opposed to the other groups that appear to have given up and are instead surfing the web on smart phones or chatting about their evening plans.

But the groups that are working quietly on the problem are the ones to watch. What happens is someone will get a breakthrough and then share it with the others in the group. They often do this loudly with celebrations (I got it! The answer is X! What you've got to do is this!) and the student who cracked through shows what he knows to the others. Sometimes, other groups figure out someone made progress and send a representative over to see what is going on.

Other groups are more subtle. They call me over to check their work. If it looks good, I try to draw class attention to it. What I try to do is point out one group appears to have solved the problem. I check their work and tell them it looks good. If they have a particularly good solution, I might ask the student to bring his laptop up, put it on the screen, and let him explain the solution.

By negotiating I mean not changing the class format or course content because students are uncomfortable with them. There is nothing wrong with listening to students and learning their concerns. Gathering feedback on the method is valuable and helps shape how you might approach the class next time. I like your survey approach and I am sure it improves your teaching. But what I don't do is change the approach because students feel they have too much work to do, or because they are uncomfortable having to take an active role in their learning, or because they find learning "hard" under the new method, or because they prefer the traditional chalk-and-talk approach. I let them express their feelings but I don't change the approach. Instead, I try to show them how to make the new system work well for them. I try to counter their objections and show them ways to adapt to the new approach.

How does the amount of learning in your class compare using your new flipped classroom versus-your-old lecture method?
How do grades and the completion rate compare between the two?
What methods do you use to engage your weaker students?

The amount of learning seems to be about the same, depending on how you measure it. I mean we cover the same materials in the same amount of time. We are on a quarter system, and we have a lot of material to get through, so usually I have to drop something by the end. My observation is that we get through about the same amount of material as we did before flipping.

But I find we go a bit more in-depth into the material we do cover. I can give them more problems to work with than I could before, and I can up the sophistication of the problems, because I am there in the class to help them through the tough material. And I have more one-on-one interaction with students on the material, which I hope helps them master it better.

The completion rate is about the same. If people drop out they have to do it within the first two weeks. Those numbers haven't changed much. And the number of students leaving and asking for a Withdrawal or Incomplete is about the same, maybe even fewer.

Grades have definitely gone up, maybe by 5 to 10 points on average. It really depends on the class and the size. In my advanced classes, the grades tend to have gone up more, but that is partly because those are smaller classes and the students want to be there and are more motivated to do the work. In the introductory class, there has been a definite improvement but on a smaller scale.

I find there are two types of students who want more one-on-one time. They are the weaker students and those who are really interested and want to make sure they are learning all they can. So weaker students get more one-on-one time, and I ask them to come in to my office hours for help. I have some students who sit in my office the entire office hour working on problems, asking questions, or going over results from in-class assignments, quizzes, and tests.

Philipp Spitzer's picture

Hallo!
Thank you for sharing your experiences. Reading them is very interesting.
In point 3 you mentioned that floodding students with information could be one possibility to better prepare them for the class. In point 2 before you talked about Just-in-Time Teaching. If you flood your students with information, could it be one possibility to set up bigger classroom-projects? There could be more complex projects and themes to handle with. Maybe you could think about a week-project or somethin like that.