DAC Office Hours - Maine.gov

1

DAC Office Hours

Friday May 28, 2021

Please post questions you may have in the chat box – we will work to answer them during the session and add them to a Q & A document.

We will begin shortly.

2

Welcome

Agenda

• NWEA Updates

• Science Updates

• General Updates

• Q & A

We’ve heard concerns from folks regarding the inclusion of homeschool student performance data in district aggregation that may also impact reporting to school boards. Please leave homeschool student data in the MARC platform through 7/9 by which time, the Maine DOE will have received a comprehensive data file for all students from NWEA. After 7/9 the school is then able to suppress the data from the homeschooled students therefore removing it from district aggregation. The Maine DOE and NWEA will be providing additional guidance on how to complete this process in subsequent slides.

Additionally, once all data is exported to MAARS – Maine’s Assessment and Accountability Reporting System, the homeschool students will be listed as “outplaced” and will not be included in district aggregations.

3

NWEA Homeschool Student Data

• Home school student data will appear in the MARC platform

• Included in district aggregation

• Suppress in MARC after 7/9

• Homeschool students will be

disaggregated within MAARS

The following criteria must be met for re-administration approval:• Student rapid-guessed >30% of the time• Student completed session <20 minutes• Student achieves >10 RIT points lower than a previous 20-21 window (fall 2020 or

winter 2021)• Student took session without proper accommodations or student was given

accommodation that was not approved

Submit re-administration request to Assessment Coordinator, Nancy Godfrey at [email protected]

4

NWEA Re-administration policy

Su bmit r e-administration request to Assessment Coordinator, Nancy Godfrey a t [email protected] .

Please reach out to Nancy PRIOR to re-administering the assessment to ensure applicability of the re-administration, however response time may be delayed. To improve response time please include: NWEA Irregularity in the subject line.

When submitting an email request please include:

• Include NWEA Irregularity in the subject line

• District ID# & Name

• School ID# & Name

• Student SSID#

• Content area/test session name (Reading or Math) & grade level

• Description of what transpired including reason for re-administration per policy allowable reasons

The following criteria must be met for re-administration approval:

• Student rapid-guessed >30% of the time – what was the rapid guess percentage?• Student completed session <20 minutes – in what time frame did the student

complete the session?• Student achieves >10 RIT points lower than a previous 20-21 window (fall 2020 or

5

NWEA Re-Administration Requests

• NWEA Re-Administration Policy

• When submitting an email request please include:

• Include NWEA Irregularity in the subject line

• District ID# & Name

• School ID# & Name

• Student SSID#

• Content area/test session name (Reading or Math) & grade level

• Description of what transpired including reason for re-

administration per policy allowable reasons

winter 2021) - please document RIT score variations• Student took session without proper accommodations or student was given

accommodation that was not approved – what was the accommodation error?

5

If a NWEA Session re-administration has been approved by DOE, please complete the following process to supress/exclude the first session from reporting.

A person within the NWEA platform who has permissions for this process are "Data Administrator" (a NWEA defined role in MARC)

Slide includes a direct link to, and the DOE Assessment/NWEA webpage, where to find this policy. If in doubt or have any questions, please reach out to [email protected]

6

NWEA Suppression & Exclusion

If a NWEA Session re-administration has been approved by DOE, please complete the following

process to suppress/exclude the first session from reporting.

A person within the NWEA platform who has

permissions for this process are "Data

Administrator" (a NWEA defined role in MARC)

NWEA Re-Administration Policyh ttps://www.maine.gov/doe/Testing_Accountability/MECAS/NWEA

Technically this exclusion process should be done by a DAC, but person or persons within the NWEA platform who has permissions for this process are "Data Administrator". This must be done in accordance to the NWEA Re-Administration Policy.

Within the NWEA platform:•Select “Manage Students”•Find and select the student who retested•Click View Update Test Events•Select the Original Test you wish to exclude•Click “Exclude from Reports” and click OK to the next prompt

7


Excluding Test Results in NWEA

• Completed by DAC/NWEA Data Administrator

• •Select “Manage Students”• •Find and select the student who retested• •Click View Update Test Events• •Select the Original Test you wish to exclude• •Click “Exclude from Reports” and click OK to the next

prompt

To Confirm the Checkbox in the Included in Reports column will be replaced with a single dash. NWEA has a short video showing this process at https://player.vimeo.com/video/332775295

After approximately 24 hours, the test results will no longer be included in your reports.

8


To Confirm the Checkbox in the Included in Reports column will be replaced with a single dash.

NWEA Video https://player.vimeo.com/video/332775295

After approximately 24 hours, the test results will no longer be included in your reports.

DOE has discovered an error that within the NEO roster that is sent to NWEA listing students who are eligible for this assessment, some SAUs may find that there are students who qualify for the Alternate MSAA Math/ELA assessment and should not be administered NWEA.

This error must be corrected by Maine IT, and will not occur until after the testing window. We apologize for the inconvenience. DOE will remove any alternate students from the results file clean-up process.

9

NWEA Roster

DOE has discovered an error that within the NEO roster that is sent to NWEA listing students who are eligible for this assessment, some SAUs may find that there are students who qualify for the Alternate MSAA Math/ELA assessment and should not be administered NWEA.

This error must be corrected by Maine IT, and will not occur until after the testing window.

DOE will remove any alternate students from the results file clean-up process

If there are technical platform issues for NWEA administration, please contact:Help Desk:NWEA [email protected]

10

NWEA Help/Support Desk

If there are technical platform issues for NWEA administration, please contact:

Help Desk:

NWEA 855-430-1777

[email protected]

We are half way through the Science assessment window, and hope everyone is caught up on Science administration training, so as a reminded all the above information has been included here as a general reminder. All recordings can be located at the Zendesk at MESCIENCE.ZENDESK.COM

11

Maine Science – Webinar reminders

What’s Different about the Maine Science Assessment – NGSS Overview video (30 min)

Q & A Session Recording - Wh at's New a bout the Maine Session NGSS -

ba sed Assessment (1 h our)

Lockdown Browser Installation:

Lockdown Browser Installation and Setup In structions

Dev ice and System Requirements for Online Assessment

Q & A Session Recording – In stallation of the ADAM Lockdown Brower and Technical Requirements

Science Online Assessment AdministrationT echnology User Guide for Sch ool & District Assessment Coordinators

T echnology User Guide for Assessment Proctors

Q&A Session Recording - ADAM Online Assessment Administration: Rostering,

A ccessibility, & Pr octoring (1 .3 hours)Al l Recordings available: https://mescience.zendesk.com/

The Science helpdesk has been receiving a high volume of calls related to the rostering of students within the platform. The following materials are also available within the Zendesk FAQ section. Some of these resources and materials are highlighted in the slide.

12

Maine ScienceAdditional Support – Rostering

Resource: FAQ’s: https://mescience.zendesk.com/hc/en-us/sections/1500000445901-FAQ

• Adding Classes and Enrolling Students - Alternative Methods

• Where do I find the Class sourcedId?

• Modify a Class and Enroll Students Into a Class One at a Time (Alternative to the Quick Class Upload Method)

• Adding a Class One at a Time (Alternative to the Quick Class Upload Method)

The process of emailing Nancy Godfrey, DOE adding homeschooled student to the Daily Change File that runs every evening to New Meridian/Science ADAM platform, is not appearing timely nor efficient.

Beginning Monday 5/24/21, all homeschooled students will be added to the Science/ADAM platform, but not be visible to schools and flagged "inactive". Therefore you will not need to email DOE/Nancy Godfrey with these requests, rather contact the Science/ADAM help desk, and they will be able to change platform flag from "inactive" to "active" with minimal wait time.Science/ADAM Platform Help [email protected]

Please be prepared with the following information: Student SSID#

Please note that once you call MEScience Help Desk with a request, it will take approximately 30 minutes until you see the homeschooled student added to your ADAM roster, and then you will still need to add student to a class roster for testing.

13

Science -Including Homeschooled Students

Beginning Monday 5/24/21, all homeschooled students will be added to the Science/ADAM platform, but not be visible to schools and flagged "inactive"

Beginning Monday 5/24 you will not need to email DOE/Nancy Godfrey with these homeschool requests

Instead contact the Science/ADAM help desk and they will flip from "inactive" to "active" with minimal wait time

Science/ADAM Platform Help Desk855-544-0842

[email protected]

Information Needed = Student SSID number

If you have missing students in your Science/ADAM platform, check your enrollment to confirm:• Student is in applicable testing grade (5, 8 or 3rd year HS)• Student is not Alternate MSAA eligible• If student is homeschooled, follow new process in previous slide

Once those checks are no's and student is missing, please provide the following, and I will add to the daily change file upload. After you get the SSID to me, the missing student should appear in your roster the following day, however if there are any enrollment glitches that prevent the student's SSID to be added to your roster, Nancy Godfrey receives a notification from Assessment Team Data Analysist Varun indicating why the addition was unsuccessful, and Nancy will notify you of the enrollment error.

14

Science -Missing Students in ADAM?

If you have missing students in ADAM platform, please double check the following:

• Might the student be enrolled in the wrong grade?

• Might the student participate in alternate assessments?

• Might the student be homeschooled?

If confirmed no's

please email the following information to [email protected]

If there are technical platform issues for Science/ADAM administration, please contact:

Science/ADAM Platform Help Desk

855-544-0842

[email protected]

OR

https://mescience.zendesk.com/hc/en-us/requests/new

15

Science/ADAM Help/Support Desk

If there are technical platform issues for Science/ADAM administration, please contact:

Science/ADAM Platform Help Desk

855-544-0842

[email protected]

OR

https://mescience.zendesk.com/hc/en-us/requests/new

2021 state assessments with the exception of NWEA MAP growth math and reading, must be administered in-person. For the in-person assessment Science, which is the only in-person assessment open until 6/11, we ask that districts/schools conduct best faith efforts to bring students in for these assessments, with plans in place following COVID health and safety guidelines, during the Science assessment window.

NWEA, the only other assessment that still remains open until 6/15, can be given remotely, and an allowable reason would be if a student did not have reliable internet connection in their home. Although NWEA is a choice on the bulk request spreadsheet, submitters should not be using this for the reason that "student is fully remote". Fully remote students are able to take the NWEA from their homes. Individual requests for NWEA exemptions would be better submitted via the NEO/Maine Educational Assessment special consideration module for reasons of Significant Medical Emergency (with medical professional documentation), or explanation of lack of reliable internet.

Should a parent determine a student will not participate in the NWEA assessment remotely, this student is considered a non-participant and is not eligible for a special consideration.

16

Special Considerations

• Individual requests for Significant Medical Emergency reason (other than COVID-related) still via the NEO/MEA Module h ttps://neo.maine.gov/DOE/NEO/Accounts/Account/Login

• Bulk upload process information posted• h ttps://www.maine.gov/doe/Testing_Accountability/MECAS/materials

• Applicable to COVID-19

• Special consideration windows remain open for NWEA Math/Reading, and Maine Science

When using the bulk excel spreadsheet, please note the following:

• The yellow line is only an example

• It appears you can only submit Alternates/MSAA and ACCESS requests, however.....

17

Special Considerations Bulk

When using the bulk excel spreadsheet, please note the following:

• The yellow line is only an example

• It appears you can only submit Alternate/MSAA

requests

However..... If you hover over each column header (yellow) there is a dropdown arrow for all other assessments for you to pick. This spreadsheet with dropdown choices was designed for all Maine Educational Assessments, but the drop down choices do not go

away when an assessment window closes.

For example you are able to choose the ACCESS and the Alternate ACCESS, but you should not choose that because the window closed 4/16/21. The same applies to the ability to choose both Alternate MSAA Math, ELA, and Alternate MSAA Science, but again you should not choose those assessments because the window closed 5/14/21.

As mentioned previously, the bulk spreadsheet process should now primarily be used for the New Meridian Science assessment.The use of the bulk spreadsheet should be used for:• As the Maine Science online assessment cannot be administered remotely, we ask

schools to make best faith efforts to bring students into school setting, whether in small groups, staggered scheduling, etc. to participate but we realize the logistics for schools either in full remote or hybrid can be a challenge

• If after offering parents/students the option to come in person to school solely for the timeframe needed for the Science assessment, and parents decline due to

18

Special Considerations Bulk

If you hover over each colunm header (yellow) there is a dropdown arrow for all other assessments for

you to pick

COVID/pandemic safety concerns, not because they are 'opting out'

18

Thank you to those who have reached out with questions regarding certifying data related to special considerations (exemptions) from assessment. Due to the unforeseen extensions to all assessment windows and the added ability for SAUs to request special considerations via a bulk upload as a direct result of COVID-19, the data currently populated within the ESEA demographics certification only includes requests approved directly within the special considerations module. this means the data within the ESEA Demographics report related to special considerations do not necessarily reflect all special consideration requests approved to date. SAUs should disregard this data field within the ESEA demographics report at this time. Once all assessment windows are closed and data is exported to MAARS in late summer/early fall, SAUs will have the opportunity to validate the special consideration (exemption) data. Unfortunately, with so many extensions and changes this year, there was insufficient time to reflect the ongoing updates to the module. Thank you for your patience and understanding. Additional questions can be directed to [email protected]

19

Special Considerations – Data Certification

ESEA Demographics file certification

• Only includes requests approved directly in the

special consideration module

• Does not take into account bulk requests

• ***Disregard this data point in the ESEA

Demographics certification report ***

• Data will be verified once all assessment

windows are closed, and data is exported to MAARS• Questions can be directed to [email protected]

The survey can be located here: https://forms.office.com/Pages/ResponsePage.aspx?id=q6g_QX0gYkubzeoajy-GTsAyI48AS3ZKk3eUsl7UBlRUMURSUEhGWk9WSVZaMkJZM1lMTU03VVJCOC4u

20

Feedback Requested

Assessment team feedback requested

• Inform the implementation of

• Supports

• Technical assistance

• Professional development

• Link is provided in the chat

• 13 questions in total

Notes for NAEP & International Assessments

Information here on the dates for the last two windows of the monthly survey The currently open monthly data submission window will close June 2nd. The final

submission window will be June 16 – 29.

Understanding that all Maine schools will be starting the summer break soon, a fillable pdf copy of the NAEP 2021 School Survey is available for early submission of the May school data. Please contact Regina Lewis as soon as possible. Ideally the form should be returned on or before June 9th. However, Regina can enter your data for you if you miss the June 9th deadline and would still like to submit

21

NAEP & International Assessments

• Mon thly School Survey (MSS) closes June 2nd

• Fin al window of this study is scheduled for June 16-29.

• To su bmit the data prior to the window and begin enjoy ing the summer

br eak, please request a fillable PDF form a s soon as possible.• Request by completing the MS-Form will also be sent via email.

• Pl ease return by June 9th

• Recent NAEP 2019 Science Release - Tuesday, May 25, 1-2:15 pm

• PISA 2021 has a few Ma ine Schools

• Notification will take place soon.

• A ssessment Window September 20, 2021 – October 29, 2021

• NA EP h elpdesk – phone: 800-283-6237 or email: [email protected]

the PDF prior to or during the submission window. The survey gathers monthly summary information regarding grade 4 and 8 student instructional modes and attendance rates.

Request a Copy of the fillable PDF using the MS-FormLink for pasting: https://forms.office.com/Pages/ResponsePage.aspx?id=q6g_QX0gYkubzeoa

jy-GTqIc01DUMrZHrgp8Z8X573JURVdCU1oxNUJTUDdWVlRYQjJCTzZPVUtPTy4u

Fillable PDF SubmissionFor this submission you will need to complete the following steps by Wednesday, June 9.

1. Download and save the survey PDF, available here. (link for pasting: https://docs.mynaep.com/MySchool/documents/MSS_Final_Collection_NAEP.pdf)2. On page 1, enter your district and school name.3. All questions refer to how students attended school in the month of May. Record your answers to the 10 questions.4. Save your PDF file and include your school’s name in the filename.

Example: MSS_Final_Collection_SCHOOLNAME.pdf5. Send your completed pdf as an email attachment to

[email protected]

The Program for International Student Assessment

(PISA) 2021 A small number of Maine schools have been selected for the PISA sample has a small number of Maine SchoolsProgram for International Student Assessment (PISA) is the largest international education study in the world and measures the mathematics, reading, science, and financial literacy of students nearing the end of compulsory education. PISA measures student performance in reading,

21

mathematics, and science literacy. More information, including the PISA Data Explorer and the 2018 Study Results, is available here on the PISA website. https://nces.ed.gov/surveys/pisa/

• Notification will take place soon.• Administered to 15 year old students• Assessment Window September 20, 2021 – October 29,

2021

NAEP 2019 Science Results released Tuesday, May 25th 1 –

2:15 pm ET

The National Assessment Governing Board and the National Center for Education Statistics (NCES) will a virtual event with discussion and analysis of the 2019 National Assessment of Educational Progress (NAEP) Science results for grades 4, 8, and 12. The event featured the 2019 NAEP

Science results and highlighted a few of the released items

from the assessment.

To view the recording proceed to

https://www.nagb.gov/naep-results/2019-science-

release.html NAEP science assessment information and

reports are available here at

https://nces.ed.gov/nationsreportcard/science/

21

To follow up on questions posed in relation to the availability of data and the provision of reports, we had indicated we would share the dates the Department receives preliminary data files, when the “clean up” is completed and the date the final data file is available. As you can see from the able within the slide, we are in the process of confirming the date for the final science file but all other data files will be received prior to mid-July. Once received, the Department ensures alignment with the certification reports and begins working with our reporting vendor FocalPointK12 to upload the data into MAARS. Once in MAARS, districts are provided between 2-4 weeks to review the data in UAT. Upon verification, the data is then finalized to production with the district obtaining full access to all data.

*The science date has now been added. Due to the extension of the window, the need to hand scoring in addition to the machine scoring the final data file will be received early September.

The team continues to review generated report processes in order to ensure reports are provided that are meaningful to families and provide information that is helpful in supporting their child/student's education. More to come.

22

Result Data Files

A ssessment Preliminary Clean up Final

N WEA 07/09/2107/09/21-07/19/21

07/19/2021

Science 06/22/2106/22/21-07/06/21

9/10/2021*

A ccess 05/20/2105/20/21-05/28/21

06/18/2021

MSA A 06/16/2106/16/21-06/21/21

07/01/2021

Accountability Certif ication report w ill be available for district review May 15 –

June 15, 2021.

** Please note, to not duplicate efforts, EL exemption verification will be

included in the MAARS data verification review in the early fall and w ill not

be included in the accountability certif ication.

This w ould only apply to districts/schools w ith recently arrived learners. **

Public comment in regarding to Maine's waiver from accountability and reporting is now open and will run through 5/10. Comments should be sent to [email protected]

For the redesign conversations, an email was provided to the 147 interested participants on 4/27 requesting individuals identify which sessions they plan on attending. Overview sessions are scheduled for later this month.

23

Public Comment & Assessment/Accountability Redesign

Waiver from accountability & Public Reporting

• Public comment period closed May 10, 2021

regarding Maine's request for a waiver from accountability and reporting requirement and

has been submitted to USDOE.

Redesign

• Initial communication to the 147 individuals

that expressed interest (4/30). First assessment session was held 5/20 with approximately 70

educators attending, first accountability session held 5/26 with approximately 50 attending.

Please don’t hesitate to reach out to the team with any questions or concerns.

24

@maine.gov

Jodi.Bossio-Smith

• MSAA Math & ELA/Literacy

• MSAA Science

• ACCESS & Alternate ACCESS for ELLs

Nancy.Godfrey

• NWEA Math & ELA/Literacy

• Maine Science

Regina.Lewis

• NAEP

• International Assessments

25

Questions & Answers

DAC Office Hours - Maine.gov

Documents

Transcript of DAC Office Hours - Maine.gov