Tuesday, December 17, 2013

Challenges and Hopes

Jennifer Blake
Marin Academy
www.ma.org

I came into this group project excited about my group members, intrigued by our idea, and uncertain as to how I could most help my school.  Ultimately, as I talked with others about this idea of examining our mission and the implicit promises we make to students and families, and how can we measure our results, I decided to focus on a programmatic area that was an extension of my current work. 

As a school, we have lots of anecdotal information about our students and their success beyond MA.  We also have a good sense of how prepared they are as they leave for college.  And yet, we've never measured our graduates systematically about the connections between their experiences at MA and their collegiate undertakings.  As co-director of college counseling, we had just begun to explore the idea of surveying graduates, and last year we asked sophomores in college a series of questions about their college counseling experience which was quite helpful.  Now we wanted to explore questions we might ask graduates about their education at MA and how that has impacted their college experience.  After discussion about survey length and “survey fatigue” with our Director of Alumni Relations, we decided to split the survey into two parts:

1.     Sophomores (every other year), questions about how well prepared they felt as they began college and about how well each academic department prepared them. 

2.     Seniors (every year), questions about what they have chosen to major in, and then which department at MA most prepared them for that major.  Depending on which department the graduate chooses, a set of questions generated by that department would come up.  Finally, we would ask questions about the qualities we hope to cultivate in all students: collaboration, cultural awareness, and leadership and which elements (if any) of the MA extracurricular program helped develop those skills.

Working with first my school's Academic Dean, and then with members of our Academic Affairs Committee (AAC) including the Department Chairs, we have begun to tweak the specific language of both surveys. The initial draft of the survey used language from the school’s mission statement and philosophy statement but after conversations with the AAC, we dropped that explicit connection.  The group felt that by the time we asked seniors in college about these things, they would not resonate as much as themes and skills that are stressed in daily work.

This work will also help inform the school’s work on its next accreditation by giving us more measurable and quantifiable data about how well we do what we do, in a way that goes beyond college admissions decisions and SAT/ACT scores.  It is also our hope that by receiving more regular feedback about many aspects of our program, we can better measure whether or not we are indeed living up to our promises, and maybe even make bigger ones!

Thursday, December 12, 2013

What are we really promising?

James Milford
Darlington School
www.darlingtonschool.org 


Our group's essential question was, "Are we delivering what we promise to deliver?"  

The challenging/fun part of this was the difference between our schools.  Ultimately we found that each of our schools made promises, held up some, failed at some, but in the end - we had the responsibility to find ways to push our schools to move toward fulfilling them. 

The Plan -  We knew that we would have to tease out the promises through creative conversations and a lot of work.  I believe you always have to have a good motivation, or at least a clear one to get things done.  

I shared with my faculty that we had received consistent feedback over the years from first year faculty/staff that certain parts of the orientation process needed work. So, I chose to work these questions into a project to feed our orientation program change.  I shared, "we are revamping our orientation program for our new faculty/staff this coming year."  At this full faculty meeting I told everyone that I was starting to dream about faculty orientation and if anyone else would be interested in joining me in this Low Commitment activity I would love to be able to think about things with them.  About 25 expressed interest (Faculty of 120).  To start I sent them the following document (cut and pasted below)


Thank you for taking the time to be present physically but also mentally for this project.  My hope is to enter into a very deliberate process to find a solid orientation and induction process that maximizes our effectiveness with all new and current employees.  In doing this I am going to attempt to minimize time taken from your already full days and work through very focused, purposeful meetings that maximize our effectiveness.
Below are a set a questions specifically designed to draw out answers to lead our discussion and work in our next meeting.
Please be fully and deeply honest on all of these as this is our chance to get it all out and clarify our views on these issues.
We will compile all answers and use them next Thursday as we take the next step.  Please feel free to email your responses back to me or bring them to the meeting next week.
What are the 10 implicit promises in our Mission?  Frame these as “Darlington promises to…” or “Your child will…”
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
What are the top three challenges you face in carrying out your job?
1.
2.
3.
What is the most frustrating thing about our students?
1.
Parents?
1.
School rules?
1.
When you think about our internal culture, what are we missing?
What are the things that will/should automatically separate you from the Darlington community?  In other words, what will get you fired?
What are the 5 essential qualities a Darlington faculty/staff member should value above others?
1.
2.
3.
4.
5.


I received these back and had a drop in meeting at lunch in a side room with expo markers and notepads and collected the answers for: 1. Promises we make, 2. Challenges we face, 3. Qualities of a Darlington Teacher and had them do a rating of their top 5 on the spot.  I then made a survey on survey monkey to collect the remaining ratings and identify what the faculty felt were more important than the others.  (I also had the administration take the same survey separately and shared how their perception of what is important is different than what the general faculty's perception is) Below are those results.


The Question was:
Check five (5) boxes next to the promises we make as a school that are the most important or meaningful.  These can be promises we currently make or those we should be making. Listed below are the main ideas completing the following statements:  Your child will attain...  Your child will learn...  Your child will possess... We will...

Options to choose from came from every theme listed from the individual worksheet above.

Link to active survey here: http://www.surveymonkey.com/s/OrientationFirstStep - please don’t complete the survey


So, I now have my top 10 promises (themes of those promises) we make. I then followed up with the following survey: 


http://www.surveymonkey.com/s/VS789JR  Results are below.  As you can see, some are still in the process of discussion about how to measure.


Top 10 results below.


Promise Theme
% support
Measure
1
Ready for college
53.8%
Alumni Survey 1st year and 4th year out
2
Teach students how to serve
46.2%
Service Hour requirement
Qualitative surveys with those we serve.
3
Act with Integrity
46.2%
How have we educated with c curriculum
# DC/HC cases
# of commendations
survey opposing coaches
don’t look at demerits
4
Promote Safety (Physically and Emotionally)
42.3%
No place for Hate Program
Counseling office do anonymous survey of how safe they feel (tailored to guys/girls)


5
Promote respect
38.5%
How do we measure this?
6
Hires Best teachers & evaluates regularly
34.6%
Evaluation process measurement??
Student survey on teachers?  At end of year do a survey and deliver it to the department chair.
Matt will get a copy from Avon.
7
Build Character
34.6%
How do you measure Character.  What does this mean developmentally?  Create essential questions and have them answer in order to gauge attitudes and opinions at their stages.
8
Develop lifetime learners
30.8%
Alumni survey.  10 - 15 years out.
Professions of our alumni
9
Critical Thinkers
30.8%
ERB, PSAT, SAT scores?
10
Ignite Passion
23.1%
Senior exit surveys?  Finding out where they are going and why - did they find their passion here?
Alumni Surveys?
Are there things discovered here that change your life.


These results I took and had individual meetings with the appropriate administrators/directors and did my best to make sure these were worked into the appropriate parties goals for the year.  I originally chose orientation because I own the program and could ensure implementation. 

This year's orientation was informed by these promises and we made sure the themes were referenced throughout the week and I continue to work to make sure we are pushing ourselves to measure our success in these areas.