1.1. Returning Applicants and Readers

You will need to complete an application for the 2026 Scoring Season to be considered for upcoming Projects. You will be sent an invitation to reapply for the 2026 Scoring Season. It will include the information/link to the application process so that you can complete the questionnaire and be included in the pool of readers for the 2026 Scoring Season.

Measurement Incorporated’s HelpSpot Knowledge Books (https://measurementinc.helpspot.com/index.php?pg=kb) are your avenues for researching most questions you may have regarding the Reader/Evaluator position.

HelpSpot ticket submissions (https://measurementinc.helpspot.com/index.php?pg=request) are your avenues for communication if you cannot find the information you need.

To receive all correspondence needed during any phase of your experience with Measurement Incorporated, you should have these email addresses in your safe sender’s list. If you do not, you may miss important information, notifications, and updates.

• measinc.com
• mystaffingpro.com
• hrservicesinc.com

Measurement Incorporated’s Application, Hiring, Training, and Scoring processes are unlike other companies that do similar work. We expect you to read and follow all the instructions and status updates provided to you for every scoring season you participate in as well as every project assignment you work on.

1.2. Enhancements to Reader Monitoring

Measurement Incorporated employs automated enhancements to our Reader monitoring capabilities. These enhancements are designed to provide you with quick feedback to help improve your performance on items where you may be having some difficulty. You will continue to have access to a Team Leader to answer your scoring questions throughout the project; these enhancements are intended to be a supplement to the type of monitoring and feedback MI has provided in the past, and they will consist of responses for you to either score or review.

Because these enhancements are auto-generated by our scoring system (MIRA), some of our typical feedback tools will be disabled when you are asked to score and/or review these responses. For instance, if you attempt to send a note to leadership on any of the auto-generated sets of responses, you will receive a message indicating that this option is not available.

The most prominent enhancement we have rolled out is an Automated Reader Recalibration set (ARR). Each of these sets will contain up to 10 responses focused on a single item.  The first few responses in this set will have been recently scored by you. Your scores will differ from the scores given by the second Reader. On these, you will see the two discrepant scores. Please review the responses carefully, as they have been selected to assist you in the areas where you are having some difficulty agreeing on the score.

The last five responses in this set will have been scored independently by two other Readers whose scores agreed. You will not have scored these responses yourself; our system will select them and send them to you as helpful examples to assist you in the areas where you are having some difficulty. On these, you will see the final, agreed-upon score. Please review these responses carefully,

Should you encounter similar responses in live scoring and have any questions about them, please send them to your leadership with a note. Your leadership will be happy to discuss them with you.

NOTE: ARR sets will be generated automatically by the MIRA system and sent only to you. Your Team Leader and Scoring Director do not have access to these sets and cannot answer questions about responses included in these sets.

MI hopes you will enjoy the opportunity to receive timely feedback designed to improve your performance on each item to which you are assigned. We are confident that these enhancements will boost each Reader’s individual performance and, in so doing, improve the overall quality of our work. We sincerely appreciate your cooperation and attentiveness as we continually strive to improve.

1.3. Reader Monitoring: My Accuracy Is Unacceptably Low

Measurement Incorporated (MI) uses several processes to monitor Reader accuracy and production. Our system is constantly reviewing data for each Reader in real time, and each morning the system summarizes Reader performance and determines whether each Reader’s accuracy and production are above average, average, below average, or unacceptably low.  A Reader whose accuracy is determined to be ‘unacceptably low’ is encouraged to review their training materials and to send scoring questions to their leadership for feedback. Additionally, a Reader may receive unsolicited feedback from their leadership team in an attempt to help improve their accuracy. Our goal is to help all our Readers improve and to have a successful, rewarding experience while scoring for MI, and we use all tools at our disposal to assist anyone whom the system identifies as a potential beneficiary of targeted feedback and recalibration.

1.4. How MI Uses Validity Responses

At Measurement Incorporated, we use multiple metrics to evaluate scoring accuracy at the group, item, and individual reader levels. One important tool for collecting these metrics is the use of validity responses. An industry-standard tool for evaluating reader accuracy, validity responses have been a key part of MI’s scoring process since the 1980s.

Validity responses are pre-scored by leadership, managers, and/or MI’s automated scoring engine, Project Essay Grade (PEG), to determine the true score for each response. These responses are included in operational scoring sets and are indistinguishable from operational student responses, providing a reliable benchmark for evaluating your ability to apply the scoring criteria accurately and consistently.

Validity reports, used by scoring leadership and managers, reflect:

• Your overall agreement with validity true scores.
  
  
• Any scoring trends you exhibit, such as a consistent tendency to assign lower (severe) or higher (lenient) scores than warranted.
  
  
• The difficulty of each validity response. Some responses clearly represent a specific score point and are easier to score accurately, while others contain characteristics of multiple score points and are more challenging. This variation is intentional, as it reflects the range of responses seen in operational scoring.

By analyzing scoring patterns across a large pool of validity responses, MI provides tailored feedback to help you monitor your scoring quality and adjust any trends that may impact accuracy. If your validity results indicate inaccurate or biased scoring, you will receive targeted feedback—both automated and from scoring leadership—to help you refine your approach.

We encourage you to use this feedback to improve your scoring by:

• Reviewing your training materials.
  
  
• Submitting line-call responses to leadership for guidance.
  
  
• Making the necessary adjustments to align with scoring expectations.

Accurate and bias-free scoring is essential to maintaining the integrity of the assessment process and ensuring that every student receives the score they have earned. Your role as a reader has a direct impact on students and their educational outcomes. We appreciate your commitment to fairness, consistency, and high-quality scoring, and we are here to support you in achieving those goals.

 

Thank you for your dedication to this important work.

1.5. Enhanced Scoring Quality Indicators in the New Scoring System

2.1. All Projects

Once you accept a specific project job offer, you will receive a projected start date and a projected end date. The start date will be confirmed via an official training assignment that has all information included to report to work for your project.

There may be times during a project when there is insufficient work available. Also, the final day of a project can be hard to predict until there is only a few days of work to complete. Your scoring system dashboard as well as other resources provide information about work availability and "Out of Work" messages. It is important to access these resources and follow the instructions provided.

Please see the following Chapter 2.2, Reporting to Work After a Hiatus and System Announcements, for specific updates on reporting to work based on your assignment.

NOTICE: Employees are only paid for time spent working in MIRA. You must be logged into MIRA to be considered actively working. There are rare exceptions to this, such as meetings for leadership. Exceptions such as this will be communicated to you by Scoring Leadership prior to or during the project. Inability to access MIRA during System Maintenance will not be considered as time spent working in MIRA. 

 

2.2. Reporting to Work After a Hiatus and System Announcements

There may be insufficient work available. You can find additional information regarding Out of Work messages by checking in Tab 1 of the Resource Library located on your MIRA dashboard.

If you have been told not to report due to "out of work" messages or a notice that your group has been put on hold, please do not log in to score. This time is not authorized.

Check your project status from the list of projects below. If you’re project status indicates that you should check for work, do so only once at the beginning of your shift. Before beginning your next shift, check your assignment status below. Do not log in more than once a day to check work availability. If no responses are available after ten minutes, logout and check back the next day. 

This page will confirm the day you are to report back, by project and assignment. We appreciate your flexibility!

_________________________________________________________________________________________________

CAST

4/24 Update

• Due to a low number of responses in the system, some groups may not have any responses to score.
• If you log on and are unable to pull up responses, please log off and return at the start of your shift on Monday, April 27th.
• Thank you for your continued patience and flexibility while the flow of responses is lower than expected.

_________________________________________________________________________________________________

ClearSight Summative

5/20 Update

• The following ClearSight groups have been approved for overtime: G3 Explanatory (G3 EXP), G3 Opinion (G3 OP), G4 Explanatory (G4 EXP), G4 Opinion (G4 OP), G5 Explanatory  (G5 EXP), G5 Opinion (G5 OP), G6 Argumentative (G6 ARG), G7 Argumentative (G7 ARG), and GHS Argumentative (GHS ARG).

_________________________________________________________________________________________________

CSA Speaking and Writing

4/27 Update

• Scoring is ongoing. If you receive an out-of-work message, please try again tomorrow.

_________________________________________________________________________________________________

ELPAC 26 - Speaking and Writing OP

5/19 Update

• Overtime is no longer authorized for the ELPAC Summative project.

• Grades K-2 Readers: If there is no work available today, please log out of MIRA and check back later this afternoon or tomorrow. More responses are expected. 

• For Grades 3-12: If there is no work available today, please log out of MIRA and check back later this afternoon or tomorrow. More responses are expected. 

• You may score between the hours of 7:00 am – 1:00 am Eastern Time, Sunday – Friday and  Saturday from 7:00 am – 11:00 pm Eastern Time.

_________________________________________________________________________________________________

Maryland Spring OP

5/26 Update

• OT for MD Science has ended. Live scoring continues. If you run out of responses, please log out of MIRA and you may check back each weekday at 8am, 2:15pm, and 6:30pm EST daily.

_________________________________________________________________________________________________

MCAS Civics

5/26 Update

• If you receive an Out of Work message, please log out and check back again tomorrow.

_________________________________________________________________________________________________

MCAS ELA G3-8

5/26 Update

• Scoring for all grades on MCAS ELA Operational has concluded. Thank you all so much for your hard work and dedication to completing this project.

_________________________________________________________________________________________________

MCAS Math

5/22 Update

Grades 3-8:

• Overtime is approved for G3-8 Readers, TLs, and SDs until further notice.
• Readers can work up to 10 hours per day.
• You may now score between the hours of 7:00 am to 10:00 pm ET Monday through Friday and 8:00 am to 8:00 pm ET Saturday and Sunday.

Grade 10:

• Training completed on 5/20. Scoring has begun.

_________________________________________________________________________________________________

NC EOC Spring Operational

• Work is expected to be available on Friday morning, 5/29. A large batch of responses is incoming.
• You may score between the hours of 7:00 am – 3:00 am Eastern Time, Sunday – Friday and on Saturday from 7:00 am – 11:00 pm Eastern Time.
  • DO NOT exceed 40 hours in one pay week (Sunday - Saturday) or work more than 12 hours per day.
    • Please note that leadership and technical support may be limited over the weekend.
• If you receive a no work available message, please log out for the day and then check in daily at the beginning of your shift to see if more work is available to score.
• Although we are asking you to check-in once daily, DO NOT log in more than once a day to check for work availability. You should also check the hiatus message for any more specific instruction.

_________________________________________________________________________________________________

New Jersey ELA Model Scoring

• Training is now available for new readers.
• Overtime is authorized for all NJ Model Scoring Readers. 
  • You may work up to 12 hours in a day
  • If you are scoring a project that is not authorized for overtime, switch to NJ only after you hit forty hours for the Sunday through Saturday work week.
• Saturday and Sunday work is authorized. The availability of leadership and support may be limited over the weekend.
• Scoring hours have been extended. You may score between 7 am and 3 am ET.
• Please check for Resolutions at the beginning of each shift. If there are no resolutions to score, return to Score Normal.
• When you begin scoring, start with the first item in the drop-down list. If no work is available for that item, check the other items starting with the next one on the list.
• When you open a set, please score it completely before opening another set or logging out. Try not to leave open sets at the end of your shift. 
• For Readers who are currently training: 
  • Training takes place in the NJ ELA 2025-2026 - Fall FT project.
  • Scoring will take place in the NJ ELA 2025-2026 - Spring Model Scoring project. 
  • There will be a delay between the time you successfully complete training and the time you are set to score in Model Scoring. Check Model Scoring periodically. Please do not contact Helpspot unless 24 hours have passed since you successfully completed training.
  • When you begin scoring, look at all the documents in the Supplemental Materials section of the Resource Library. There is some important information there that you need to review. 

_________________________________________________________________________________________________

New Mexico SBA Spanish Reading OP

5/15 Update

• All readers are currently out of work. We do not anticipate having any more responses to score. Thank you for your hard work on this project!

______________________________________________________________________________

Oklahoma OSTP OP

5/14 Update

• There is no further work available for the OK OSTP project, as the project has now concluded. No additional time will be approved. Thank you all for your hard work and contributions—we truly appreciate your efforts.

_________________________________________________________________________________________________

Smarter Brief Writes

5/26 Update

• If you receive an Out of Work message, please log out and check back again tomorrow.

______________________________________________________________________________

Smarter Full Writes

5/26 Update

• All Full Writes Grades/Partitions: If you are currently training, please continue.
• Readers: Scoring is available for all groups. If you run out of responses today, please log off and check back at the start of your next shift.
• Overtime has been authorized and the daily limit is 12 hours per day.

______________________________________________________________________________

Smarter Math

5/26 Update

• Readers and Leadership currently scoring: If you receive an Out of Work message, please wait 10 minutes and check for more responses; if there are still no responses, please log out and check back again tomorrow.
• Overtime is authorized and readers may work up to 12 hours per day.

________________________________________________________________________________________________

Smarter Reading

5/27 Update

• All Readers and Team Leaders: Please switch to the NJ ELA project where you may begin training. If you have any questions, please contact HelpSpot. 
• Thank you for all your hard work in Reading!

______________________________________________________________________________

Smarter Research

5/26 Update

• If you receive an Out of Work message, please log out and check back again tomorrow.

______________________________________________________________________________

All Projects

Employees are only paid for time spent working in MIRA. You must be logged in to MIRA to be considered actively working. There are rare exceptions to this, such as meetings for leadership. Exceptions such as this will be communicated to you by Scoring Leadership prior to or during the project. Inability to access MIRA during System Maintenance will not be considered as time spent working in MIRA.

________________________________________________________________________________________________

System Announcements

When system maintenance occurs, please follow this protocol:

• None at this time

 

 

2.3. Scoring System Status

When system maintenance occurs, please follow this protocol:

Nothing to report at this time.

Reminder: Employees are only paid for time spent working in MIRA. You must be logged in to MIRA to be considered actively working. There are rare exceptions to this, such as meetings for leadership. Exceptions such as this will be communicated to you by Scoring Leadership prior to or during the project. Inability to access MIRA during System Maintenance will not be considered as time spent working in MIRA.