Tag Archives: critique

R.E.A.L. Projects – Critique, assessment and tuning

This post is part of an ongoing series written by our PBL Lead Laura Jackson, about how we are implementing R.E.A.L. Projects in school.

As I said when I ended my previous post, I feel very excited when I see the staff project folders with exciting projects in them. There is a summary of all of these at the end of this post and I’m sure you’ll agree that these projects will give our students an exciting variety of different learning experiences during our projects week. I think it’s important to detail how we got to this place in such a short space of time.

Back in February, all staff spent time with our PBL coach, Cara, planting “seeds of passion”- to try to find a way to ignite little sparks of exciting energy to then develop and create into Rigorous, Engaging, Authentic Learning experiences.

These words are vital but how can we apply rigour? How can we ensure projects are engaging? How can authenticity be validated? All of these need to be encapsulated within a learning experience. What do they actually mean? How do we do it?

The Innovation Unit says:

REAL projects

 

 

We also had to decide how to assess each project and also projects had to be “tuned” to make sure they had been given critique, and that and questions the project leader or the critique group may have had about the project were acknowledged and addressed if needed.

Project Tuning

One of the most important parts of project work is the giving and receiving of critique. This happens at all stages of the project but the earliest stage would be at the “tuning” stage. This was also possibly the most challenging part to co-ordinate from my point of view as each project needed to be tuned but also as part of a group, who would be the critique providers. 

critique play doh

My critiqued creation from our session with Cara

In preparation for this, Curriculum Leaders took part in a Critique and Tuning workshop with Cara to allow them to take this process into their Project groups. I then led a critique workshop for the rest of the staff which ensured we all felt it. If you have an emotional connection with something then you feel more passionate about it and believe in it more. If people start changing things, adding bits, taking bits away then it changes YOUR work and YOUR emotional connection with the work.

It was important to me that all staff took part in this session and it was also a light-hearted way to introduce critique to staff, but with a serious message. If critique is given in the wrong way to anyone- staff creating, developing or delivering the project or students who are completing the project, then this would not be useful to anyone and would have a detrimental effect on the person receiving the critique. As adults, we are very protective of our own ideas and values and if they are questioned in the wrong way then it becomes a negative experience and this should not be the case. This is also true of our students we work with day-to-day.  This task made me think about how we self and peer critique in lessons and I intend to use the same session with students towards the end of the academic year, time willing.

power of protocols

Working with Cara has also introduced me to a fantastic book- The Power of Protocols which is extremely useful in terms of gaining the maximum usage out of a set amount of time.  This way of working was also used in a session I attended at School 21 in February when we were discussing enabling conditions for projects in schools. Although I first thought using protocols seemed very regimented, I quickly realised that having set times for different parts of discussion, meeting and critique work is actually extremely useful and stops a lot of time being wasted just chatting or wandering off topic.

To tune projects, there is a need to be very specific and concise to articulate the project to others. In the protocol there are also “norms”

  • Hard on the content, soft on the people,
  • Share the air (or “step up, step back”)
  • Be kind, specific and helpful

This allows all the conversation and discussion taking place to be focused solely on the project and the content.

Within the tuning protocol, there are also different roles :

  • Facilitator -Begins the session by reading through the protocol. During the protocol, the facilitator is responsible for keeping the discussion on point and reminding participants to adhere to the norms.
  • Timekeeper– Keeps time for each section and lets the facilitator know when time is up.
  • Presenter – Shares his/her work with the group.
  • Critical Friends – Includes all people present except for the presenter.

During the tuning process, the presenter gets time to present their project idea and the area or aspect they would like critique on. The critical friends then ask clarifying questions to gain a deeper understanding of any aspect of the project or specific area. The critical friends then discuss the project with the presenter taking notes on their discussion without being involved and then they respond to this discussion at the end. The response could take the form of addressing some of the issues discussed by others, drawing conclusions from what has been said or discussed or simply acknowledging the points made by others.  The facilitator introduces each part of the protocol and the timekeeper ensures the protocol timings are adhered to. Timings may differ depending on time constraints- we tuned projects in 15 minute blocks (2 mins- 3 mins- 8 mins- 2 mins) but clearly timings and therefore the timings within each part of the protocol can be changed as needed.

Project Assessment

As well as tuning our projects, we also needed to decide on how our projects would be assessed.

“Academic rigour- head, hand and heart” was my message from the School 21 retreat. Within our discussions in school also, the learning that would take place during the week needed to be meaningful, exciting and also rigorous. The word rigour again:

Rigour

The Innovation Unit use Buck Institute for Education’s “21st Century Skills” framework to assess PBL work. The Buck Institute website contains a myriad of resources, ideas and information about PBL from all over the world and contains some fascinating work and reading. Their twitter account is definitely worth a follow.

We focused on:

ICT Literacy

  • how to find information
  • how to use equipment

Cognitive Skills

  • Critical Thinking
  • Creative Thinking

Metacognitive Skills

  • Self- management
  • Reflection

Personal Characteristics

  • Risk Taking
  • Accountability

Interpersonal Skills

  • Communication
  • Collaboration

As Curriculum Leaders, we discussed our projects with one another and looked for assessment opportunities within these discussions. Once we had these then we put them into the categories above, to allow us to see where the most likely assessment opportunities lay in our range of projects.

From this we then decided on three assessment strands which would be able to be assessed in any project taking place. We also added a learning target to each one to show what would need to be achieved in each assessment strand.

Communication – I can communicate my learning to others in an appropriate way.

Gathering Information – I can source, locate and investigate appropriate information using ICT.

Cognitive Skills – I can reflect and adapt to overcome challenges in my learning.

After further discussion with Cara on a different day, we also decided that to assess all three in one week would be very difficult, especially because critique could lead to multiple drafts. It could also potentially dilute the quality of assessment and critique in the project. Only one strand will be assessed in each project and this is to be decided by the project delivery staff on each project.  This is another benefit of using Cara’s expertise as she works in this field and has experience in this area- I, and we, are still developing our skills all the time and this small tweak means that time will be used effectively and assessment will still be rigorous which is what we require.

From this, short term learning targets have been created within the project plans to individualise the learning target for the projects.

Finally, I would also like to share the variety of projects staff have created and the essential questions driving the projects.

Project Title Essential Questions
Would you feed your hungry neighbour?
  • 1 in 5 UK mums regularly skip meals to be able to afford to feed their children – is this fair?
  • If your neighbour was hungry would you help them?
  • Almost 1 million people living in the UK needed emergency food supplies from 2013-14, how can we help?
Zombie Apocalypse
  • Are you a survivor?
  • How would society cope with the breakdown of civilisation?
  • Would you fight or flight?
Flotsam and Jetsam
  • How can we rethink our current use of material ?
  • What materials can be Salvaged/re-used ?
  • Can another use for a waste material or product be found?
  • How can we create a more sustainable lifestyle ?
Orienteering in the local community
  • What is orienteering?
  • Why is orienteering a sport that anyone can do?
  • How can we get our local community involved in orienteering?
Mood Music
  • Can music change your mood?
  • Do we respond differently to different kinds of musical stimulus?
  • Can music help us to relax/prepare for work/get us angry?
Travel Tracks
  • If you could go anywhere in the world, where would you go?
Maths Movie Making (M3)
  • What’s the problem with maths?
  • Can I make maths interesting for all students?”
Afternoon Tea
  • Can we prepare and deliver an event for the local community?
Community
  • Who were the Durham miners?
  • What can we learn about community from the Durham miners?
  • How has coal shaped our community?
Set, Props and Costume
  • How can the set, costumes and props enhance the performance of Grease?
Does Fashion have a price?
  • What is the true price of fashion?
When in Rome…
  • How have the Romans left their mark on the North East?
  • How did the Romans on Hadrian’s Wall live?
  • How did the famous gladiators fight for survival in the arena?
  • What can we learn from the Romans?
Vikings
  • Vikings: Bloodthirsty raiders or cultured traders?
Durham Cathedral through your own eyes
  • What are the secrets of Durham Cathedral?
Kidz for Kidz
  • What kind of books do 5-6 year olds like to read?
  • How can we make reading enjoyable for young children?
  • How can we encourage and inspire young children to become more independent readers?
Films
  • Do films dictate our morals today?
Rock Climbing
  • Could I climb Mount Everest?
Seaham
  • Will we be able to visit Seaham beach in 50 years time?
Science: Great Beauty or Horrifying Monster?
  • Do you consider Science beautiful or does it disgust you?
21st Century Britain
  • What is British?
Trashion
  • Could you make clothes out of the things you throw away?

I intend to create a daily diary blog during our Projects Week – 29th June 2015 to document the week as it happens.

 

Advertisements

Fast Feedback 2.0

The final presentation at our lunchtime pedagogy picnic on Magic Monday 4 was by our Curriculum Team Leader for Performing Arts, Laura Jackson. Here, Laura explains how she has been developing some of the Fast Feedback ideas I shared at our first Magic Monday, as well as some new ones she’s discovered since.  Over to Laura……….

Colour coding is used widely in schools – even our student planners have red, amber and green pages for them to show understanding or communicate messages to staff. It is an excellent way to give visual indications and clear action points immediately.

What is RAG?

RAG just stands for Red, Amber and Green.

How can it help me?

There are many ways you can incorporate RAG into your daily schedule to save you time, without compromising on quality.

I have used colour coding in several different ways in all of my lessons to try to see which ideas work best and how.

My BTEC Music students have been using colours to show how far through the task they are and also their level of understanding of each task:

  • Red was still unsure
  • Amber was a good understanding
  • Green was confident enough to explain the concept to someone else

The benefits have been:

  • Fast
  • Visual
  • Easy and clear to understand
  • Student and teacher friendly
  • Minimal cost

RAG1

Dots, boxes and stars

I developed the use of dots from Dan’s “Fast Feedback” blog post from the first Magic Monday. I have been developing student led critique in my classrooms and I thought this may save me even taking the books home to formally mark.

The majority of my “marking” is listening work: Performances and composition work are critiqued as part of the development process and performed when complete. Dots can be used as indicators for students when they are doing a task, without talking or interrupting the flow or their concentration. By giving the work a quick visual check I can quickly judge a student’s understanding and give feedback. It also allows me to correct misconceptions or obvious errors before a task is completed, giving my students a chance to improve instantly.

I have used larger box shapes for my BTEC/ KS4 classes so they can write inside the boxes. It has been successful with units where facts and roles need to be learnt, allowing students to write about areas of strength and security, as well as weaknesses or areas to be developed.

I have also used gold stars to highlight examples of excellence – work to display and show others to aid the critique process by getting students to discuss what great work looks like.

#RAG123

I discovered Kev Lister’s #rag123 on Twitter and instantly saw how I could develop my current system into a more formal marking process. I contacted him and he sent me his marking guide, which I adapted slightly to fit my own needs. Kev writes “R2/ G2” but as I already had the dot stickers I thought I could pre-populate them and just stick them on the work.

The process is simple:

  • Decide on criteria – classroom/ subject/ department
  • Perform a quick visual check
  • Grade using RAG123 criteria
  • Students then respond/ critique / improve

LJA RAG marking guide

I also liked the fact that students had the opportunity to rate themselves which provided quick self assessment opportunities which didn’t have to be formalised.

My findings

  • Marking smarter doesn’t result in a lower quality response

I found that the level of response from students was better than the feedback tickets I had been using previously. It also put the work back in the hands of the student as when I used the code, they had to think about why they had been given that code. More often than not they actually knew, especially if we did class critique. If they didn’t know then it gave them the opportunity to peer critique their partner or neighbour’s book and again, it meant that it was giving the students the power to manage their own learning. It also meant I could then spend time working with students who were “code red” and may need extra support in that particular task.

  • Marking smarter means I have more time to develop other ideas

It is a fast system – you can do a quick visual check and correct spellings if necessary – very quickly without compromising on the quality of the marking.

  • Marking smarter can improve student motivation and quality of work

After 2/3 weeks, students were much more motivated in tasks to complete work with higher quality answers first time as they did not want red on their books. This is something I hadn’t anticipated at all and meant a rise in the quality of all work.

  • Marking smarter can improve the quality of peer and self assessment

The students were brutally honest in peer and self evaluations and I found this refreshing as they were not just rating themselves “green 1” just because it was good.

It is definitely something I will be continuing to develop in my lessons and with my groups, and hopefully implement throughout the whole department.

An Ethic of Excellence

We recently held the first in a series of voluntary curriculum conferences for mid-leaders to share their ideas about what might influence the design of our new post-levels curriculum.

Ideas that were shared during our first meeting:

  • Designing a new English curriculum and post-levels assessment system from scratch (which you can read all about here)
  • An Ethic of Excellence
  • Using cognitive science to inform curriculum design
  • Assessing without levels

Ethic of excellence, Berger

For those of us that have already read ‘An Ethic of Excellence’ by Ron Berger, I’m sure most of us would agree on the deep and lasting impression it left upon us.  For many of us, myself included, it has had a transformational effect on our work as teachers and school leaders.

Here, Head of Performing Arts Laura Jackson, shares her thoughts on the book and how it has influenced her thinking.

“It’s not a quick fix, it’s a way of life”

Ron Berger was an American Elementary School teacher .  He was a craftsman, a carpenter by trade.  He believes that “work of excellence is transformational. Once a student sees that he or she is capable of excellence, that student is never quite the same.”

An Ethic of Excellence

The book is written as a personal account of his findings, more like a story than an academic style book.  In it he talks about the culture he has embedded in his own school and then in others as a consultant – that excellence cannot be achieved first time.

An Archiver of Excellence

Berger collects student work for his portfolio which has been built up over many years.  The sharing of student work for the purposes of modelling and critique is central to his teaching repertoire.  Archived work is shared with students.  It shows development and progression – from first draft to “excellence”.  Students spend time discussing the work of others and receiving critique on their own.

We were then treated to this, now legendary video of Ron Berger in action.  It demonstrates the power of archived work in supporting students to achieve excellence, through the process of critique and re-drafting.

A School Culture of Excellence

The culture we create rests in our community – “in every effective school I’ve seen has a strong sense of community….staff and students in all these settings feel that they are part of something – that they belong.”

Positive Peer Pressure is used to create a safe learning environment, where striving for excellence is encouraged.  Here, the positive critical feedback outlined above is crucial in achieving this.

Bigger is better?  WE ARE LUCKY! “in a small school students and staff are highly accountable – it’s hard for the students to fall through the cracks”  this is a privilege for us – we can make a bigger difference!

Work of Excellence

“We can’t first build up self-esteem and then focus on their work. It is through their own work that their self-esteem will grow.”

Project based learning is at the heart of the curriculum.  The curriculum is “thematic” containing multidisciplinary themes over weeks and even months.  High quality projects are celebrated everywhere so that the ethic, understanding and motivation are there right from the start.

Literacy and numeracy are built in throughout the curriculum – from basic to higher order skills.  Work completed is genuine, of integrity and requires students to carry out their own research.

Assessment is continuous and used to build stronger students.  Multiple drafts of work are the norm.  Critique is used prior to each new draft, which must be:

  • Kind – safety
  • Specific – no wasting time
  • Helpful – to help the individual not the critic

“Students need to know from the outset that quality means rethinking, reworking, and polishing. They need to know that they will be celebrated, not ridiculed, for going back to the drawing board.”

At the end of the year all student work is presented to a panel and made public through exhibitions or performances.  Work is recorded to show the next intake what is expected in a year.  Deadlines must be met – positive pressure is used throughout to ensure excellence.

Teaching of Excellence

The critique process doesn’t just apply to students, however.  Teachers also critique each other’s work, and are expected to present and explain strategies that might be recommended.  Teaching is seen as a craft – and with ‘expert’ status requiring as much as 10000 hours, feedback on practice is welcome and supports improvement.  Relationships are seen as central to getting the best out of each other.

“Teaching isn’t about papers and pencils, it’s about relationships”.

Building strong relationships makes it much easier to ask ourselves and each other the fundamental question:

“How do we make the work stronger?”

Impact

To finish, Laura shared some of the ways in which the book has already impacted on her practice:

  • Critique – first draft listening marked by students and re-written.  This may take time away from “music” but when doing a similar task for the first time several weeks later, there was a marked improvement in first drafts.
  • Excellence – Displaying the work for others to see, collecting a portfolio of “excellence” as a hard copy and a visual file to show students and staff.
  • Adding context / value – Year 9 “showcase” performance – showing their best examples of performance work, Year 7 “Creative Arts Celebration Evening”
  • Collecting examples of excellent work, evidence of excellent performances and practice work to display.  Once it’s set up it is easy to update and develop.

Music examples of excellence wall zoom

Music wall of excellence 2

An Ethic of Excellence, by Ron Berger is available from our Teaching and Learning library