Q: Who in the District will have access to teacher information and performance data?A: Security and confidentiality are fundamental priorities of the
IT Systems initiative work. The District and the PFT realize the sensitive nature of collecting data tied to individuals, and will maintain confidentiality standards to ensure that access is controlled appropriately. Those standards, along with use, accessibility and purpose of information within all IT sources will remain central to improving systems that support the success of all teachers and schools throughout the District.
Q: Will we have access from home? A: Yes! We realize that ease-of-access is fundamental to the use of technology tools for our teachers. To proactively support our teachers, the information they need must be accessible safely and conveniently wherever they work. In order to achieve this goal, the
IT Systems initiative work is focused on providing access to necessary school systems within one secure and easy-to-use web-based portal that teachers can use either on personal or school computers both within PPS buildings and outside.
Q: What changes will I see next year, and in the years to come? A: To maximize how the IT Initiative works to support the other work within the
Empowering Effect Teachers Plan, it is important that technology tools be improved upon and developed alongside other initiatives. Work has already begun, and we will continue this work with teacher and principal involvement through 2010 and into 2011. While some components may be improved or released next year, the majority of teachers and principals will only start using and relying on the improved
IT Systems in the 2011/2012 school-year.
Q: Will more IT people be hired to reach these goals? A: The District realizes that our technical staff already supports a range of IT systems and equipment throughout our schools. In order to effectively support our
IT Systems initiative, the
Empowering Effective Teachers Plan includes the addition of strategic staffing to support the planning, management, analysis and training necessary to improve existing and new IT services. By working in conjunction with our existing departments and staff, the aim is to realize our goals of the IT Systems initiative by having technical staff focused on its development alongside the other initiatives. In addition, the Plan also includes the addition of IT staff after implementation to ensure effective continuity and maintenance of the new and newly integrated IT systems.
With the development of new IT Systems, will teachers and staff have access to school systems data outside of Pittsburgh Public Schools buildings?
The Pittsburgh Federation of Teachers (PFT) and the District realize that ease-of-access is fundamental to the use of technology tools in order for teachers and staff to be successful.
To proactively support our teachers and staff, the information they need must be accessible safely and conveniently wherever they work.
In order to achieve this goal, the IT Systems initiative is focused on providing access to necessary school systems within one secure and easy-to-use web-based portal.
This new single web-based experience will be accessible to teachers and staff on personal or school computers both within, and outside of, Pittsburgh Public Schools buildings.
The IT Systems initiative will be implemented over time, with some components launching during the 2010-2011 school year, while other tools and capabilities will be rolled out over the next several years.
When and how will training be done for the new IT Systems?
The IT Systems initiative team, including Pittsburgh Federation of Teachers (PFT) and District leadership, have identified the foundational and specific technical needs of teachers and staff and established a meaningful IT improvement plan rooted in systems already operating throughout the District.
An early milestone for the IT Systems initiative is the selection of the consortium of vendors that will help us develop and implement the new IT systems.
As part of the improvement plan, the IT Systems initiative team will also engage the existing technical systems and departments and involve teachers in the development of the new IT Systems.
There is an important role for teachers throughout this process to clarify and prioritize user needs, test and give feedback as systems develop, and train colleagues and peers on how to use them.
Training on certain features might start as early as late summer or early fall 2010 on some of the first elements of these new systems.
Throughout the development and implementation of new IT Systems, will be ongoing training available online and through internal staff and teachers who participate in the design and testing of the system.
Back to Top
Research-Based Inclusive System of Evaluation (RISE)
Q. How was RISE developed?
A. The Research-based Inclusive System of Evaluation (RISE) was developed in response to teachers' desires for an improved evaluation system that more effectively supports, empowers and recognizes teacher practice.
From the beginning, RISE was designed to be an equitable, fair and rigorous evaluation system. The intention of RISE was to collaboratively design a new teacher evaluation system informed by and for Pittsburgh teachers.
In May 2009, the RISE Design Team consisting of about 120 teachers, principals, and District and PFT leaders, spent four days developing the evaluation system. During the 2009-2010 school year, 24 schools chose to participate in the pilot.
The Design Team met throughout the 2009-2010 school year and continues to refine the RISE process. Teachers have contributed countless hours to create a tool that will be fair to their colleagues. In 2010-2011 the system will be expanded to include all schools.
On May 13th, 2010, District administration and PFT leadership hosted an event to celebrate a successful 2009-2010 pilot year and induct new pilot schools beginning RISE next school year.
At the event, pilot schools were paired with non-pilot RISE schools for next year. Pilot schools will provide support to non-pilot schools during their first year of implementation.
Over the course of a two-day retreat - on May 12 and 14, 2010 - a group of teachers, principals, District staff and PFT leaders developed a plan for the supported growth strand of RISE, which will be piloted in District schools in the 2010-11 school year.
In June and August, non-pilot RISE schools will have opportunities to be trained on RISE prior to the start of the 2010-11 school year and work with RISE pilot schools as part of this training.
Additional information on RISE: Post-Gazette article, Spring Issue of The Pittsburgh Educator, eNews Archive
Q. What does highly-effective teaching mean?
A. As we know, great teaching is multi-dimensional. Therefore, it should be viewed through multiple measures, none of which are sufficient to stand alone. The District and the Pittsburgh Federation of Teachers (PFT) have been collaborating on a system of evaluation to inform and move teacher practice.
According to the Research-Based Inclusive System of Evaluation (RISE) model, effective PreK-12 teachers are professional educators who:
- Hold high expectations for all students and the belief that effort creates ability;
- Know their students, content and the curriculum thoroughly and have a broad repertoire of content-specific, culturally responsive strategies and activities to use with students to meet rigorous learning goals;
- Demonstrate flexibility to meet their students' learning needs and use formative assessment to adapt instruction to maximize learning opportunities for all students;
- Establish rituals and routines that foster a safe learning environment where effort is privileged allowing students to fully engage in instructional activities, ask questions and take part in class discussions; and
- Work continuously to improve their practice and knowledge of students while acting as a resource for others in their professional learning community.
During the 2009-10 school year, RISE was piloted in 24 schools. In 2010-11, RISE will be rolled out District-wide.
As RISE is implemented, and as additional tools such as Value-Added Measures (VAM) are developed, processes will be formed to apply these measures to improve decision-making and to reach a widely shared and accepted understanding of highly-effective teaching.
Throughout, this work will build on existing initiatives within the District, most notably RISE, and the collaborative process which has been critical to its success thus far.
Additional information on RISE: Post-Gazette article, Spring Issue of The Pittsburgh Educator, eNews Archive
Q. What were the results of the RISE Pilot Survey?
A. In the recently conducted year-end RISE Pilot Survey, completed by 418 respondents, over 80% of responding school staff from the 24 RISE pilot schools indicated they were satisfied with the RISE evaluation process. Furthermore, 93% of survey respondents felt engaged as active participants in the evaluation process.
"I think the collaboration of the teacher and principal is essential and important. I also like the fact that the teacher is able to provide evidence and play a more integral part in the evaluation process." -Survey Respondent
Respondents indicated that the Research-based Inclusive System of Evaluation (RISE) process was useful in supporting their professional development and that the process itself was administered effectively. For instance:
- 99% of respondents strongly agreed or agreed that "Teachers in my school want to continuously improve their practice."
- 95% of respondents strongly agreed or agreed that "My principal effectively evaluates teachers using the RISE process."
- 88% of respondents strongly agreed or agreed that "The RISE evaluation process supported and encouraged my professional growth."
Survey respondents also mentioned the need to address the somewhat cumbersome nature of the evaluation tool. With the help of teachers, we are working to address this concern through the IT Systems initiative.
Q. Will all schools in the District participate in RISE in the 2010-11 school year?
A. The collaborative momentum of RISE (Research-Based Inclusive System of Evaluation) builds next year as all schools in the District participate in the evaluation process.
As this successful pilot year came to a close in 200-2010, another group of RISE teacher leaders began training with the tool to take it back to their schools next year.
Each of the pilot schools paired with at least one new RISE school to provide support through their first year of implementation. On June 7 and 8, 2010, representatives from new RISE schools, supported by their RISE pilot school, participated in a training session that will enable them to share RISE with their colleagues at a June 21 professional development session.
RISE pilot schools are expected to offer support and guidance to the new RISE schools they are paired with by:
- Attending summer training sessions,
- Inviting their new RISE schools to observe formal observations of teachers who have already been through the RISE process,
- Visiting their new RISE schools to observe and support formal observations, and
- Providing support throughout the next school year.
Additionally, the Pittsburgh Federation of Teachers (PFT) and consultants from the Danielson Group will offer added support through regular site visits. Paired schools may also choose to observe each other's site visits.
Beginning in the fall 2010-2011, new RISE schools will participate in the formal observation module. Schools in their second year of RISE (about 2/3 of staff) will participate in the formal observation module or pilot the supported growth module (up to 1/3 of staff).
Special schools will also participate in the RISE process next year and help us learn more about how we can best apply the RISE rubric to their schools, including any modifications that might need to be made.
Over the 2010 summer, we will be working with our IT vendor, Global Scholar, to ensure that RISE will become an automated process. For more information about the RISE process, click here.
Q. What is the supported growth module?
A. Over the course of a two-day retreat - on May 12 and 14 - a group of teachers, principals, District staff and leaders from the Pittsburgh Federation of Teachers (PFT) developed a plan for the supported growth module of the Research-based Inclusive System of Evaluation (RISE).
The supported growth module will be piloted in District schools in the 2010-11 school year and will:
- Encourage collaboration within schools to grow student learning;
- Honor the presumption of professionalism to continually improve practice;
- Promote individualized teacher learning, teacher reflection, and growth of practice;
- Support school and District initiatives;
- Provide assessment-driven professional growth based on evidence from student learning data, school data, self-assessment, administrators evaluations, etc.; and
- Provide job-embedded learning and growth opportunities.
The supported growth module will enable about one-third of experienced teachers from current RISE pilot schools to engage in a rigorous, year-long study targeted specifically toward improving their practice in one or more components of the RISE framework. Teachers will meet with their principal regularly for support and feedback.
RISE was developed in response to teachers' desires for an improved evaluation system that more effectively supports, empowers and recognizes teacher practice.
From the beginning, RISE was designed to be an equitable, fair and rigorous evaluation system. The intention of RISE was to collaboratively design a new teacher evaluation system informed by and for Pittsburgh teachers.
Value-Added Measures (VAM)
Q. When will the model for the District's Value-Added Measure (VAM) be constructed and rolled out?
A. Value-Added Measures (VAM) go beyond a simple measure of average classroom achievement in order to provide a more accurate picture of a teacher's contribution to student learning.
Currently, we are working with Mathematica Policy Research, Inc.and the American Federation of Teachers (AFT) to develop a Value-Added Measure and other measures of teacher effectiveness that are as fair and transparent as possible.
Later this spring, Mathematica will report on VAM simulations run with anonymous, historical PPS PSSA data in reading and math (grades 4-8). This work is meant to be illustrative of how data from these assessments might work in a Value Added analysis. The information from these simulations will be used to inform the VAM development process. Results will be anonymous, and will not be used for evaluative purposes.
This Fall Mathematica will calculate VAM scores for the first time and will do so in each subsequent Fall, refining the measure each time. We have contracted with Mathematica through 2014 for technical assistance.
The Teacher Practice and Evaluation initiative recognizes the complexity and the importance of effective teaching. We are committed to working together with teachers, Mathematica and the AFT to ensure that the VAM tool is an accurate and a fair measure of a teacher's contribution to student learning.
Q. What are the challenges of collecting VAM (Value-added Measures) given the high number of transient students?
A. Currently, we are working with Mathematica Policy Research, Inc. and the American Federation of Teachers (AFT) to develop a Value-Added Measure (VAM) and other measures of teacher effectiveness that are as fair and transparent as possible.
The VAM data system we are developing will track the moves of individual students, making it possible to attribute a student's achievement gains proportionally to the teachers and schools in which he or she was enrolled.
Students enrolled with a teacher or school for a minimal number of days can be excluded from calculations. In addition, teachers will have the opportunity to verify the accuracy of the student rosters used in their VAM calculations.
Finally, the VAM will make statistical adjustments for the expected achievement gains of highly transient students.
Q. What is the VAM Student Learning Subcommittee?
A. The VAM Student Learning Sub-committee is part of the larger Teacher Practice and Evaluation initiative. The Sub-committee includes the Value Added Measure (VAM) Development Team (consisting of PFT and District staff, American Federation of Teachers leaders and Mathematica consultants), in collaboration with the Research-based Inclusive System of Evaluation (RISE) Design Group.
Currently, 44 volunteers have signed up for the Student Learning Sub-committee including five principals, 32 teachers and seven other district staff. These numbers include three Special Education teachers, and one Early Childhood Supervisor.
These volunteers are participating in the process of developing a useful system of measurement surrounding student learning as it relates to measures of effective teaching. This is an important process with potential to provide valuable information to teachers and principals that will be useful to improving teaching and learning.
The goals of the Student Learning Subcommittee are to:
- Gain a deeper understanding of the strengths, limitations and potential uses of VAM, and other measures associated with student learning.
- Study the use of VAM and other measures of student learning as they relate to the component of RISE that involves student assessment data.
- Assist in the development of ways to report VAM and other measures so that all teachers can use the information to influence their value added.
- Be involved in shared decision-making and planning for system-wide and sustained professional development on using information from VAM and other measures to improve practice.
- Help with sharing information at the schools about VAM and other measures.
The Student Learning Subcommittee is still looking for English Language Arts and Social Studies teachers to volunteer. If you are interested, please contact Mary Wolfson by emailing mwolfson1@pghboe.net or calling 412-622-3924.
Q. How is the use of student achievement data in VAM different than current uses of student achievement data?
A. In the attainment model currently used, student achievement data indicate whether students are performing below, at or above grade level.
In the Value Added Model (VAM), student achievement data are used to measure how much growth students make from year to year, regardless of whether students are performing below, at or above grade level.
The Value Added Research Center (VARC) has developed an analogy illustrating the differences between the attainment model and the Value Added Model.
Please visit the The Oak Tree Analogy to view the three-minute slide show from the Value Added Research Center.
There are some real challenges with value-added measures, including the fact that currently they can only be calculated for subject areas that have valid standardized tests. However, value-added measures are recognized to be a fairer use of test scores to understand a teacher's impact on student achievement because they are based on growth rather than absolute scores.
Q. How will we ensure the VAM model is accurate and valid?
A. We are planning to convene a VAM (Value-Added Measure) Technical Advisory Board to help guide the VAM development process.
This group, which would consist of professionals with expertise in value-added measurement, would provide input into the ongoing process of developing models that help measure a teacher's contribution to student learning.
Specifically, members of the VAM Technical Advisory Board would be asked to offer feedback to the work of Mathematica Policy Research, Inc. and suggest revisions to increase the applicability and reliability of the measurements.
We are currently working with Mathematica and the American Federation of Teachers (AFT) to develop this Value-Added Measure and other measures of teacher effectiveness that are as fair and transparent as possible.
Other Measures
Q. What is the Measures of Effective Teaching research project?
A. The District and the Pittsburgh Federation of Teachers (PFT) recently pursued and were awarded a separate grant to participate in the Measures of Effective Teaching (MET) research project from the Bill & Melinda Gates Foundation.
During the 2009-2010 school year, we began participating in this groundbreaking two-year national project to develop fair, consistent and reliable measures of effective teaching.
The goal of the Measures of Effective Teaching (MET) research project is to help educators and policymakers identify and support good teaching by improving the quality of information available about teacher practice. Approximately 3,700 teachers, in a number of districts around the nation, will participate in this project.
One example of how this funding will be used includes the opportunity to get feedback from all of our teachers to directly inform strategies to improve the teaching and learning environment through the creation of the Teaching and Learning Conditions Survey.
Additionally, through the MET research project, Pittsburgh Public Schools teachers will have the opportunity to participate in the development of new measures of teacher content knowledge closely tied to the practice of teaching.
Great teaching is multi-dimensional. We therefore believe it should be viewed through multiple measures, none of which are sufficient to stand alone. Teachers should know what expectations are for good teaching and what they can do to improve their practice.
Q. What is the Knowledge for Teaching Assessments project?
A. Pittsburgh Public Schools (PPS) is participating in a two-year research project to develop fair and reliable measures of effective teaching called the Measures of Effective Teaching (MET) project.
The Knowledge for Teaching Assessments is part of the Measures of Effective Teaching research project and represented another opportunity for Pittsburgh teachers to volunteer and provide their input, and further improve the quality of information available about teacher practice.
Teachers choosing to participate received a $50 gift card for each assessment they complete. The Knowledge for Teaching Assessments administration dates were as follows:
- Mathematics teachers in Grades 4 - 5 and ELA in Grades 4 - 6: May 17 - June 30, 2010
- Mathematics teachers in Grades 6 - 8, Algebra I, and ELA in Grades 7 - 9: July 1 - August 31, 2010.
If you have additional questions or comments, please contact Mary Wolfson in the Pittsburgh Public Schools Office of Research, Assessment and Accountability.
Teaching and Learning Environment
Q: How will student discipline be enforced and supported?A: If our schools are not safe and orderly, teachers cannot teach and students will not learn. Trying to measure the effectiveness of teachers is a waste of time if the teaching and learning environments are disrupted. The District will focus on simultaneously driving the following four initiatives:
- Establishing behavior expectations of students that promote learning and college-readiness;
- Empowering teachers as leaders in maintaining a positive learning environment;
- Providing wrap-around support to assist with behavior-related interventions;
- Continually assessing improvements in the learning environment.
As an initial step, we need to take stock and better utilize current teaching and learning environment related resources and initiatives in the District. The District currently invests in many programs and support services such as the Student Assistance Program (SAP), Positive Behavior Intervention Supports (PBIS), and various forms of alternative education. Our goal is to strengthen and connect these programs to teachers' practice so that the teaching and learning environments will foster positive behaviors and academic success.
Through the collective work of the District and the PFT, assistance will be provided to , school-based teams like the Discipline Committees and Student Assistance Teams.
Q: What are some specific things that will happen?A: Consistent with our focus on empowering our teachers as leaders in maintaining a positive learning environment, we recognize that this initiative needs to be particularly responsive to the teacher experience and expertise.
A teaching conditions survey developed by a leading expert in the field, will be administered in April to gather baseline information from all of our teachers. This will form the foundation of much of our work. However, here are a few specific things that are already in the works:
To do so, the District will focus on simultaneously driving the following four initiatives:
- Establishing behavior expectations of students that promote learning and college-readiness;
- Empowering teachers as leaders in maintaining a positive learning environment;
- Providing wrap-around support to assist with behavior-related interventions; and
- Continually assessing improvements in the learning environment.
As an initial step, we need to take stock and better utilize current teaching and learning environment related resources and initiatives in the District. The District currently invests in many programs and support services such as the Student Assistance Program (SAP), Positive Behavior Intervention Supports (PBIS), and various forms of alternative education. Our goal is to strengthen and connect these programs to teachers' practice so that the teaching and learning environments will foster positive behaviors and academic success. Through the collective work of the District and the PFT, assistance will be provided to school-based teams like the Discipline Committees and Student Assistance Teams.
What are some specific things that will happen? A: Consistent with our focus on empowering our teachers as leaders in maintaining a positive learning environment, we recognize that the
Teaching and Learning Environment initiative needs to be particularly responsive to teacher experience and expertise. A teaching conditions survey developed by a leading expert in the field (Eric Hirsch from the New Teacher Center) will be administered, in April to gather baseline information from all of our teachers.
While the learning conditions survey will help inform much of the Positive Teaching and Learning Environment initiative, here are a few specific things that are already in the works:
1. Development of a common one-page, easy to reference, set of District-wide behavior expectations;
2. Improved referral processes to make it easier to produce, track and share student referrals; and
3. Behavior Specialists, teachers with outstanding classroom management and interpersonal skills who coach peers on creating a positive teaching and learning environment.
Additional concrete items are being explored and include the development of a Teaching and Learning Environment rubric that will become part of the teaching and learning walks, and an intervention matrix that will be a useful tool for teachers to help connect students to different District wrap-around support services.
Furthermore, we are working to integrate components of the Teaching and Learning Environment into other initiatives of the Empowering Effective Teachers Plan, including the Promise-Readiness Corps, The Teacher Academy, Career Opportunities, IT Systems, and additional District systems. To do so we will be addressing the Teaching and Learning Environment in District leadership groups such as Academic Cabinet. These efforts represent a coordinated approach to significantly improve teaching and learning environments in our schools and positively impact student achievement.
One of the three strategies in our Plan is to
"ensure that all teachers work in learning environments that support their ability to be highly effective."As you know, we are committed to creating a
Positive Teaching and Learning Environmentin every school that establishes and reinforces positive student behaviors and a culture of Promise-Readiness.
To do so, we pursued and have been awarded a separate grant from the Bill & Melinda Gates Foundation to conduct an
anonymous and confidential Teaching and Learning Conditions Survey. All teachers, principals and other certified educators will be provided with a special code to participate in this online survey, which will be accessible starting on April 19.
To protect confidentiality, the survey data will be aggregated at the school level. We believe that information about the teaching and learning environment of your school will be extremely valuable, and should be used to help shape each school improvement plan for 2010-11 school year.
Teachers, principals and other certified educators - please complete this anonymous Teaching and Learning Conditions Survey beginning April 19 - May 14, 2010!