Posted on 9 Comments

Why Are My Child’s Test Scores Dropping?

“I just don’t understand,” says a parent bewilderingly, “she’s receiving so many different therapies and tutoring every week, but her scores on educational, speech-language, and psychological testing just keep dropping!”

I hear a variation of this comment far too frequently in both my private practice as well as outpatient school in hospital setting, from parents looking for an explanation regarding the decline of their children’s standardized test scores in both cognitive (IQ) and linguistic domains. That is why today I wanted to take a moment to write this blog post to explain a few reasons behind this phenomenon.

Children with language impairments represent a highly diverse group, which exists along a continuum.   Some children’s deficits may be mild while others far more severe. Some children may receive very little intervention  services and thrive academically, while others can receive inordinate amount of interventions and still very limitedly benefit from them.  To put it in very simplistic terms, the above is due to two significant influences – the interaction between the child’s (1) genetic makeup and (2) environmental factors.

There is a reason why language disorders are considered developmental.   Firstly, these difficulties are apparent from a young age when the child’s language just begins to develop.  Secondly, the trajectory of the child’s language deficits also develops along with the child and can progress/lag based on the child’s genetic predisposition, resiliency, parental input, as well as schooling and academically based interventions.

Let us discuss some of the reasons why standardized testing results may decline for select students who are receiving a variety of support services and interventions.

Ineffective Interventions due to Misdiagnosis 

Sometimes, lack of appropriate/relevant intervention provision may be responsible for it.  Let’s take an example of a misdiagnosis of alcohol related deficits as Autism, which I have frequently encountered in my private practice, when performing second opinion testing and consultations. Unfortunately, the above is not uncommon.  Many children with alcohol-related impairments may present with significant social emotional dysregulation coupled with significant externalizing behavior manifestations.  As a result, without a thorough differential diagnosis they may be frequently diagnosed with ASD and then provided with ABA therapy services for years with little to no benefit.

Ineffective Interventions due to Lack of Comprehensive Testing 

Let us examine another example of a student with average intelligence but poor reading performance.  The student may do well in school up to certain grade but then may begin to flounder academically.  Because only the student’s reading abilities ‘seem’ to be adversely impacted, no comprehensive language and literacy evaluations are performed.   The student may receive undifferentiated extra reading support in school while his scores may continue to drop.

Once the situation ‘gets bad enough’, the student’s language and literacy abilities may be comprehensively assessed.  In a vast majority of situations these type of assessments yield the following results:

  1. The student’s oral language expression as well as higher order language abilities are adversely affected and require targeted language intervention
  2. The undifferentiated reading intervention provided to the student was NOT targeting actual areas of weaknesses

As can be seen from above examples, targeted intervention is hugely important and, in a number of cases, may be responsible  for the student’s declining performance. However, that is not always the case.

What if it was definitively confirmed that the student was indeed diagnosed appropriately and was receiving quality services but still continued to decline academically. What then?

Well, we know that many children with genetic disorders (Down Syndrome, Fragile X, etc.) as well as intellectual disabilities (ID) can make incredibly impressive gains in a variety of developmental areas (e.g., gross/fine motor skills, speech/language, socio-emotional, ADL, etc.)  but their gains will not be on par with peers without these diagnoses.

The situation becomes much more complicated when children without ID (or with mild intellectual deficits) and varying degrees of language impairment, receive effective therapies, work very hard in therapy, yet continue  to be perpetually behind their peers when it comes to making academic gains.  This occurs because of a phenomenon known as Cumulative Cognitive Deficit (CCD).

The Effect of Cumulative Cognitive Deficit (CCD) on Academic Performance 

According to Gindis (2005) CCD “refers to a downward trend in the measured intelligence and/or scholastic achievement of culturally/socially disadvantaged children relative to age-appropriate societal norms and expectations” (p. 304). Gindis further elucidates by quoting Satler (1992): “The theory behind cumulative deficit is that children who are deprived of enriching cognitive experiences during their early years are less able to profit from environmental situations because of a mismatch between their cognitive schemata and the requirements of the new (or advanced) learning situation”  (pp. 575-576).

So who are the children potentially at risk for CCD?

One such group are internationally (and domestically) adopted as well as foster care children.  A number of studies show that due to the early life hardships associated with prenatal trauma (e.g., maternal substance abuse, lack of adequate prenatal care, etc.) as well as postnatal stress (e.g., adverse effect of institutionalization), many of these children have much poorer social and academic outcomes despite being adopted by well-to-do, educated parents who continue to provide them with exceptional care in all aspects of their academic and social development.

Another group, are children with diagnosed/suspected psychiatric impairments and concomitant overt/hidden language deficits. Depending on the degree and persistence of the psychiatric impairment, in addition to having intermittent access to classroom academics and therapy interventions, the quality of their therapy may be affected by the course of their illness. Combined with sporadic nature of interventions this may result in them falling further and further behind their peers with respect to social and academic outcomes.

A third group (as mentioned previously) are children with genetic syndromes, neurodevelopmental disorders (e.g., Autism) and intellectual disabilities. Here, it is very important to explicitly state that children with diagnosed or suspected alcohol related deficits (FASD) are particularly at risk due to the lack of consensus/training  regarding FAS detection/diagnosis. Consequently, these children may evidence a steady ‘decline’ on standardized testing despite exhibiting steady functional gains in therapy.

Brief Standardized Testing Score Tutorial:

When we look at norm-referenced testing results, score interpretation can be quite daunting. For the sake of simplicity,  I’d like to restrict this discussion to two types of scores: raw scores and standard scores.

The raw score is the number of items the child answered correctly on a test or a subtest. However, raw scores need to be interpreted to be meaningful.  For example, a 9 year old student can attain a raw score of 12 on a subtest of a particular test (e.g., Listening Comprehension Test-2 or LCT-2).  Without more information, the raw score has no meaning. If the test consisted of 15 questions, a raw score of 12 would be an average score. Alternatively, if the subtest had 36 questions, a raw score of 12 would be significantly below-average (e.g., Test of Problem Solving-3 or TOPS-3).

Consequently, the raw score needs to be converted to a standard score. Standard scores compare the student’s performance on a test to the performance of other students his/her age.  Many standardized language assessments have a mean of 100 and a standard deviation of 15. Thus, scores between 85 and 115 are considered to be in the average range of functioning.

Now lets discuss testing performance variation across time. Let’s say an 8.6 year old student took the above mentioned LCT-2 and attained poor standard scores on all subtests.   That student qualifies for services and receives them for a period of one year. At that time the LCT-2 is re-administered once again and much to the parents surprise the student’s standard scores appear to be even lower than when he had taken the test as an eight year old (illustration below).

Results of The Listening Comprehension Test -2 (LCT-2): Age: 8:4

Subtests Raw Score Standard Score Percentile Rank Description
Main Idea 5 67 2 Severely Impaired
Details 2 63 1 Severely Impaired
Reasoning 2 69 2 Severely Impaired
Vocabulary 0 Below Norms Below Norms Profoundly Impaired
Understanding Messages 0 <61 <1 Profoundly Impaired
Total Test Score 9 <63 1 Profoundly Impaired

(Mean = 100, Standard Deviation = +/-15)

Results of The Listening Comprehension Test -2 (LCT-2):  Age: 9.6

Subtests Raw Score Standard Score Percentile Rank Description
Main Idea 6 60 0 Severely Impaired
Details 5 66 1 Severely Impaired
Reasoning 3 62 1 Severely Impaired
Vocabulary 4 74 4 Moderately Impaired
Understanding Messages 2 54 0 Profoundly Impaired
Total Test Score 20 <64 1 Profoundly Impaired

(Mean = 100, Standard Deviation = +/-15)

However, if one looks at the raw score column on the far left, one can see that the student as a 9 year old actually answered more questions than as an 8 year old and his total raw test score went up by 11 points.

The above is a perfect illustration of CCD in action. The student was able to answer more questions on the test but because academic, linguistic, and cognitive demands continue to steadily increase with age, this quantitative improvement in performance (increase in total number of questions answered) did not result in qualitative  improvement in performance (increase in standard scores).

In the first part of this series I have introduced the concept of Cumulative Cognitive Deficit and its effect on academic performance. Stay tuned for part II of this series which describes what parents and professionals can do to improve functional performance of students with Cumulative Cognitive Deficit.

References:

  • Bowers, L., Huisingh, R., & LoGiudice, C. (2006). The Listening Comprehension Test-2 (LCT-2). East Moline, IL: LinguiSystems, Inc.
  • Bowers, L., Huisingh, R., & LoGiudice, C. (2005). The Test of Problem Solving 3-Elementary (TOPS-3). East Moline, IL: LinguiSystems.
  • Gindis, B. (2005). Cognitive, language, and educational issues of children adopted from overseas orphanages. Journal of Cognitive Education and Psychology, 4 (3): 290-315.
  • Sattler, J. M. (1992). Assessment of Children. Revised and updated 3rd edition. San Diego: Jerome M. Sattler.
Posted on 4 Comments

Recommendations for Assessing Language Abilities of Verbal Children with Down Syndrome (DS)

Kid-1Assessment of children with DS syndrome is often complicated due to the wide spectrum of presenting deficits (e.g., significant health issues in conjunction with communication impairment, lack of expressive language, etc) making accurate assessment of their communication a difficult task. In order to provide these children with appropriate therapy services via the design of targeted goals and objectives, we need to create comprehensive assessment procedures that focus on highlighting their communicative strengths and not just their deficits.

Today I’d like to discuss assessment procedures for verbal monolingual and bilingual children with DS 4-9 years of age, since testing instruments as well as assessment procedures for younger as well as older verbal and nonverbal children with DS do differ.

When it comes to dual language use and genetic disorders and developmental disabilities many educational and health care professionals are still under the erroneous assumption that it is better to use one language (English) to communicate with these children at home and at school.  However, studies have shown that not only can children with DS become functionally bilingual they can even become functionally trilingual (Vallar & Papagno, 1993; Woll & Grove, 1996).  It is important to understand that “bilingualism does not change the general profile of language strengths and weaknesses characteristic of DS—most children with DS will have receptive vocabulary strengths and expressive language weaknesses, regardless of whether they are monolingual or bilingual.” (Kay-Raining Bird, 2009, p. 194)

Furthermore, advising a bilingual family to only speak English with a child will cause a number of negative linguistic and psychosocial implications, such as create social isolation from family members who may not speak English well as well as adversely affect parent-child relationships (Portes & Hao, 1998).

Consequently, when preparing to assess linguistic abilities of children with DS we need to first determine whether these children have single or dual language exposure and design assessment procedures accordingly.

Pre-assessment Considerations

It is very important to conduct a parental interview no matter the setting you are performing the assessment in. One of your goals during the interview will be to establish the functional goals the parents’ desire for the child which may not always coincide with the academic expectations of the program in question.

Begin with a detailed case history and review of current records and obtain information about the child’s prenatal, perinatal and postnatal development, medical history as well as the nature of previous assessments and provided related services. Next, obtain a detailed history of the child’s language use by inquiring what languages are spoken by household members and how much time do these people spend with the child?

Choosing Testing Instruments 

A balanced assessment will include a variety of methods, including observations of the child as well as direct interactions in the form of standardized, informal and dynamic assessments. If you will be using standardized assessments (e.g., ROWPVT-4) YOU MUST use descriptive measures vs. standardized scores to describe the child’s functioning. The latter is especially applicable to bilingual children with DS. Consider using the following disclaimer: “The following test/s __________were normed on typically developing English speaking children. Testing materials are not available in standardized form for child’s unique developmental and bilingual/bicultural backgrounds. In accordance with IDEA 2004 (The Individuals with Disabilities Education Act) [20 U.S.C.¤1414(3)],official use of standard scores for this child would be inaccurate and misleading so the results reported are presented in descriptive form.  Raw scores are provided here only for comparison with future performance.”

Selecting Standardized Assessments 

Depending on the child’s age and level of abilities a variety of assessment measures may be applicable to test the child in the areas of Content (vocabulary), Form (grammar/syntax), and Use(pragmatic language).

For children over 3 years of age whose linguistic abilities are just emerging you may wish to use a vocabulary inventory such as the MacArthur-Bates (also available in other languages) as well as provide parents with the Developmental Scale for Children with Down Syndrome to fill out. This will allow you to compare where child with DS features in their development as compared to typically developing peers. For older, more verbal children who are using words, phrases, and/or sentences to express themselves, you may want to use or adapt (see above) one of the following standardized language tests:

Informal Assessment Procedures 

Depending on your setting (hospital vs. school), you may not perform a detailed assessment of the child’s feeding and swallowing skills. However, it is still important to understand that due to low muscle tone, respiratory problems, gastrointestinal disorders and cardiac issues, children with DSoften present with feeding dysfunction which is further exacerbated by concomitant issues such as obesity, GERD, constipation, malnutrition (restricted food group intake lacking in vitamins and minerals), and fatigue. With respect to swallowing, they may experience abnormalities in both the oral and pharyngeal phases of swallow, as well as present with silent aspiration, due to which instrumental assessment (MBS) may be necessary (Frazer & Friedman, 2006).

In contrast to feeding and swallowing the oral-peripheral assessment can be performed in all settings. When performing oral-peripheral exam, you need to carefully describe all structural (anatomical) and functional (physiological) abnormalities (e.g., macroglossia, micrognathia, prognathism, etc).   Note any issues with:

  • —  Dentition (e.g., dental overcrowding, occlusion, etc)
  • —  Tongue/jaw disassociation  (ability to separate tongue from jaw when speaking)
  • —  Mouth Posture (open/closed) and tongue positioning  at rest (protruding/retracted)
  • —  Control of oral secretions
  • —  Lingual and buccal strength, movement (e.g., lingual protrusion, elevation, lateralization, and depression for volitional tasks) and control
  • —  Mandibular (jaw) strength, stability and grading

Take a careful look at the child’s speech. Perform dual speech sampling (if applicable) by considering the child’s phonetic inventory, syllable lengths and shapes as well as articulatory/phonological error patterns.  Make sure to factor in the combined effect of the child’s craniofacial anomalies as well as system wide impairment (disturbances in respiration, voice, articulation, resonance, fluency, and prosody) on conversational intelligibility. Impaired intelligibility is a serious concern for individuals with DS, as it tends to persist throughout life for many of them and significantly interferes with social and vocational pursuits (Kent & Vorperian, 2013)

Don’t forget to assess the child’s voice, fluency, prosody, and resonance. Children with DS may have difficulty maintaining constant airstream for vocal production due to which they may occasionally speak with low vocal volume and breathiness (caused by air loss due to vocal fold hypotonicity). This may be directly targeted in treatment sessions and taught how to compensate for.  When assessing resonance make sure to screen the child for hypernasality which may be due to velopharyngeal insufficiency secondary to hypotonicity as well as rule out hyponasality which may be due to enlarged adenoids (Kent & Vorperian, 2013). Furthermore, since stuttering and cluttering occur in children with DS at rates of 10 to 45%, compared to about 1% in the general population, a detailed analysis of disfluencies may be necessary(Kent & Vorperian, 2013). Finally, due to limitations with perception, imitation, and spontaneous production of prosodic features secondary to motor difficulties, motor coordination issues, and segmental errors that impede effective speech production across multisyllabic sequences, the prosody of individuals with DS will be impaired and might require a separate intervention. (Kent & Vorperian, 2013)

When it comes to auditory function, formal hearing testing and retesting is mandatory due to the fact that many children with DS have high prevalence of conductive and sensorineural hearing loss (Park et al, 2012). So if the child in question is not receiving regular follow-ups from the audiologist, it is very important to make the appropriate referral. Similarly, it is also very important that the child’s visual perception is assessed as well since children with DS frequently experience difficulties with vision acuity as well as visual processing, consequentially a consultation with developmental optometrist may be recommended/needed.

Describe in detail the child’s adaptive behavior and learning style, including their social strengths and weaknesses. Observe the child’s eye contact, affect, attention to task, level of distractibility, and socialization patterns. Document the number of redirections and negotiations the child needed to participate as well as types and level of reinforcement used during testing.

Perform dual language sampling and look at functional vocabulary knowledge and use, grammar measures, sentence length, as well as the child’s pragmatic functions (what is the child using his/her language for: request, reject, comment, etc.) Perform a dynamic assessment to determine the child’s learnability (e.g., how quickly does the child learns and adapts to being taught new concepts?) since “even a minimal mediation in the form of ‘focusing’ improves the receptive language performance of children with DS” (Alony & Kozulin, 2007, p 323)

After all the above sections are completed, it is time to move on to the impressions section of the report.  While it is important to document the weaknesses exposed by the assessment, it is even more important to document the child’s strengths or all the things the child did well, since this will help you to determine the starting treatment point and allow you to formulate relevant treatment goals.

When making recommendations for treatment, especially for bilingual children with DS, make sure to provide a strong rationale for the provision of services in both languages (if applicable) as well as specify the importance of continued support of the first language in the home.

Finally, make sure to provide targeted and measurable [suggested] treatment goals by breaking the targets into measurable parts:

Given ___time period (1 year, 1 progress reporting period, etc), the student will be able to (insert specific goal) with ___accuracy/trials, given ___ level of, given _____type of prompts.

Assessing communication abilities of children with developmental disabilities may not be easy; however, having the appropriate preparation and training will ensure that you will be well prepared to do the job right!  Use multiple tasks and activities to create a balanced assessment, use descriptive measures instead of standard scores to report findings, and most importantly make your assessment functional by making sure that your testing yields relevant diagnostic information which could then be effectively used to provide effective quality treatments for clients with DS!

For comprehensive information on “Comprehensive Assessment of Monolingual and Bilingual Children with Down Syndrome” which discusses how to assess young (birth-early elementary age) verbal and nonverbal monolingual and bilingual children with Down Syndrome (DS) and offers comprehensive examples of write-ups based on real-life clients click HERE.

Other Helpful Resources

Posted on 2 Comments

Comprehensive Assessment of Monolingual and Bilingual Children with Down Syndrome

Image result for down syndromeAssessing speech-language abilities of children with genetic disorders and developmental disabilities is no easy feat. Although developmental and genetic disorders affecting cognition, communication and functioning are increasingly widespread, speech-language assessment procedures for select populations (e.g., Down Syndrome) remain poorly understood by many speech-language professionals, resulting in ineffective or inappropriate service provision. Continue reading Comprehensive Assessment of Monolingual and Bilingual Children with Down Syndrome

Posted on Leave a comment

Research Tuesday January Edition – Speech Impairment in Down Syndrome: A Review

Research TuesdayOnce again I am joining the ranks of SLPs who are blogging about research related to the field of speech pathology.   Today I am reviewing a 2013 article in the Journal of Speech, Language, and Hearing Research, by Kent and Vorperian, which summarizes research on disorders of speech production in Down syndrome (DS)

Title: Speech Impairment in Down Syndrome: A Review

Purpose: To inform clinical services and guide future research on assessment and treatment of DS. Continue reading Research Tuesday January Edition – Speech Impairment in Down Syndrome: A Review

Posted on 1 Comment

Spotlight on Syndromes: An SLPs Perspective on Down Syndrome

Today’s guest post on genetic syndromes comes from Rachel Nortz, who is contributing a post on the Down Syndrome.

Down Syndrome is a genetic disorder that is characterized by all or part of a third copy of the 21st chromosome. There are three different forms of Down syndrome: trisomy 21, translocation, and mosaicism. Trisomy 21 is the most common form of Down syndrome. This occurs when the 21st chromosome pair does not split properly and the egg or sperm receives a double-dose of the extra chromosome. Translocation  (3-4% have this type) is the result of when the extra part of the 21st chromosome becomes attached (translocated) onto another chromosome.  Mosaicism is the result of an extra 21st chromosome in only some of the cells and this is the least common type of Down syndrome. Continue reading Spotlight on Syndromes: An SLPs Perspective on Down Syndrome