Posted on

What Should be Driving Our Treatment?

Today  I want to talk treatment.  That thing that we need to plan for as we are doing our assessments.   But are we starting our treatments the right way? The answer may surprise you. I often see SLPs phrasing questions regarding treatment the following way: “I have a student diagnosed with ____ (insert disorder here). What is everyone using (program/app/materials) during therapy sessions to address ___ diagnosis?”

Of course, the answer is never that simple. Just because a child has a diagnosis of a social communication disorder, word-finding deficits, or a reading disability does not automatically indicate to the treating clinician, which ‘cookie cutter’ materials and programs are best suited for the child in question. Only a profile of strengths and needs based on a comprehensive language and literacy testing can address this in an adequate and targeted manner.

To illustrate,  reading intervention is a much debated and controversial topic nowadays. Everywhere you turn there’s a barrage of advice for clinicians and parents regarding which program/approach to use. Barton, Wilson, OG… the well-intentioned advice just keeps on coming. The problem is that without knowing the child’s specific deficit areas, the application of the above approaches is quite frankly … pointless.

There could be endless variations of how deficits manifest in poor readers. Is it aspects of phonological awareness, phonics, morphology, etc. What combination of deficits is preventing the child from becoming a good reader?

Let’s a take a look at an example, below. It’s the CTOPP-2 results of a 7-6-year-old female with a documented history of extensive reading difficulties and a significant family history of reading disabilities in the family.

Results of the Comprehensive Test of Phonological Processing-2 (CTOPP-2)

Subtests Scaled Scores Percentile Ranks Description
Elision (EL) 7 16 Below Average
Blending Words (BW) 13 84 Above Average
Phoneme Isolation (PI) 6 9 Below Average
Memory for Digits (MD) 8 25 Average
Nonword Repetition (NR) 8 25 Average
Rapid Digit Naming (RD) 10 50 Average
Rapid Letter Naming (RL) 11 63 Average
Blending Nonwords (BN) 8 25 Average
Segmenting Nonwords (SN) 8 25 Average

However, the results of her CTOPP-2 testing clearly indicate that phonological awareness, despite two areas of mild weaknesses, is not really a significant problem for this child.  So let’s look at the student’s reading fluency results.

Reading Fluency: “LG’s reading fluency during this task was judged to be significantly affected by excessive speed, inappropriate pausing, word misreadings, choppy prosody, as well as inefficient word attack skills.  While she was able to limitedly utilize the phonetic spelling of unfamiliar words (e.g., __) provided to her in parenthesis next to the word (which she initially misread as ‘__’), she exhibited limited use of metalinguistic strategies (e.g., pre-scanning sentences to aid text comprehension, self-correcting to ensure that the read words made sense in the context of the sentence, etc.), when reading the provided passage. To illustrate, during the reading of the text, LG was observed to frequently (at least 3 times) lose her place and skip entire lines of text without any attempts at self-correction. At times she was observed to read the same word a number of different ways (e.g., read ‘soup’ as ‘soup’ then as ‘soap’,  ‘roots’ as ‘roofs’ then as ‘roots’, etc.) without attempting to self-correct. LG’s oral reading rate was also observed to be impaired for her age/grade levels. Her prosody was significantly adversely affected due to lack of adequate pausing for punctuation marks (e.g., periods, commas, etc.).  Instead, she paused during text reading only when he could not decode select words in the text.  Though, LG was able to read 70 words per minute, which was judged to be grossly commensurate with grade-level, out of these 70 words she skipped 2 entire lines of text, invented an entire line of text, as well as made 4 decoding errors and 6 inappropriate pauses.”

So now we know that despite quite decent phonological awareness abilities, this student presents with quite poor sound-letter correspondence skills and will definitely benefit from explicit phonics instruction addressing the above deficit areas. But that is only the beginning!   By looking at the analysis of specific misreadings we next need to determine what other literacy areas need to be addressed. For the sake of brevity, I can specify that further analysis of this child reading abilities revealed that reading comprehension, orthographic knowledge, as well as morphological awareness were definitely areas that also required targeted remediation. The assessment also revealed that the child presented with poor spelling and writing abilities, which also needed to be addressed in the context of therapy.

Now, what if I also told you that this child had already been receiving private, Orton-Gillingham reading instruction for a period of  2 years, 1x per week, at the time the above assessment took place? Would you change your mind about the program in question? 

Well, the answer is again not so simple! OG is a fine program, but as you can see from the above example it has definite limitations and is not an exclusive fit for this child, or for any child for that matter. Furthermore, a solidly-trained in literacy clinician DOES NOT need to rely on just one program to address literacy deficits. They simply need solid knowledge of typical and atypical language and literacy development/milestones and know how to create a targeted treatment hierarchy in order to deliver effective intervention services. But for that, they need to first, thoughtfully, construct assessment-based treatment goals by carefully taking into the consideration the child’s strengths and needs.

So let’s stop asking which approach/program we should use and start asking about the child’s profile of strengths and needs in order to create accurate language and literacy goals based on solid evidence and scientifically-guided treatment practices.

Helpful Resources Pertaining to Reading:

 

Posted on

New Products for the 2017 Academic School Year for SLPs

Image result for back to schoolSeptember is quickly approaching and  school-based speech language pathologists (SLPs) are preparing to go back to work. Many of them are looking to update their arsenal of speech and language materials for the upcoming academic school year.

With that in mind, I wanted to update my readers regarding all the new products I have recently created with a focus on assessment and treatment in speech language pathology.

My most recent product Assessment of Adolescents with Language and Literacy Impairments in Speech Language Pathology  is a 130-slide pdf download which discusses how to effectively select assessment materials in order to conduct comprehensive evaluations of adolescents with suspected language and literacy disorders. It contains embedded links to ALL the books and research articles used in the development of this product.

Effective Reading Instruction Strategies for Intellectually Impaired Students is a 50-slide downloadable presentation in pdf format which describes how speech-language pathologists (SLPs) trained in assessment and intervention of literacy disorders (reading, spelling, and writing) can teach phonological awareness, phonics, as well as reading fluency skills to children with mild-moderate intellectual disabilities. It reviews the research on reading interventions conducted with children with intellectual disabilities, lists components of effective reading instruction as well as explains how to incorporate components of reading instruction into language therapy sessions.

Dysgraphia Checklist for School-Aged Children helps to identify the students’ specific written language deficits who may require further assessment and treatment services to improve their written abilities.

Processing Disorders: Controversial Aspects of Diagnosis and Treatment is a 28-slide downloadable pdf presentation which provides an introduction to processing disorders.  It describes the diversity of ‘APD’ symptoms as well as explains the current controversies pertaining to the validity of the ‘APD’ diagnosis.  It also discusses how the label “processing difficulties” often masks true language and learning deficits in students which require appropriate language and literacy assessment and targeted intervention services.

Checklist for Identification of Speech Language Disorders in Bilingual and Multicultural Children was created to assist Speech Language Pathologists (SLPs) and Teachers in the decision-making process of how to appropriately identify bilingual and multicultural children who present with speech-language delay/deficits (vs. a language difference), for the purpose of initiating a formal speech-language-literacy evaluation.  The goal is to ensure that educational professionals are appropriately identifying bilingual children for assessment and service provision due to legitimate speech language deficits/concerns, and are not over-identifying students because they speak multiple languages or because they come from low socioeconomic backgrounds.

Comprehensive Assessment and Treatment of Literacy Disorders in Speech-Language Pathology is a 125 slide presentation which describes how speech-language pathologists can effectively assess and treat children with literacy disorders, (reading, spelling, and writing deficits including dyslexia) from preschool through adolescence.  It explains the impact of language disorders on literacy development, lists formal and informal assessment instruments and procedures, as well as describes the importance of assessing higher order language skills for literacy purposes. It reviews components of effective reading instruction including phonological awareness, orthographic knowledge, vocabulary awareness,  morphological awareness, as well as reading fluency and comprehension. Finally, it provides recommendations on how components of effective reading instruction can be cohesively integrated into speech-language therapy sessions in order to improve literacy abilities of children with language disorders and learning disabilities.

Improving critical thinking via picture booksImproving Critical Thinking Skills via Picture Books in Children with Language Disorders is a partial 30-slide presentation which discusses effective instructional strategies for teaching language disordered children critical thinking skills via the use of picture books utilizing both the Original (1956) and Revised (2001) Bloom’s Taxonomy: Cognitive Domain which encompasses the (R) categories of remembering, understanding, applying, analyzing, evaluating and creating.

from wordless books to reading From Wordless Picture Books to Reading Instruction: Effective Strategies for SLPs Working with Intellectually Impaired Students is a full 92 slide presentation which discusses how to address the development of critical thinking skills through a variety of picture books  utilizing the framework outlined in Bloom’s Taxonomy: Cognitive Domain which encompasses the categories of knowledge, comprehension, application, analysis, synthesis, and evaluation in children with intellectual impairments. It shares a number of similarities with the above product as it also reviews components of effective reading instruction for children with language and intellectual disabilities as well as provides recommendations on how to integrate reading instruction effectively into speech-language therapy sessions.

Best Practices in Bilingual LiteracyBest Practices in Bilingual Literacy Assessments and Interventions is a 105 slide presentation which focuses on how bilingual speech-language pathologists (SLPs) can effectively assess and intervene with simultaneously bilingual and multicultural children (with stronger academic English language skills) diagnosed with linguistically-based literacy impairments. Topics include components of effective literacy assessments for simultaneously bilingual children (with stronger English abilities), best instructional literacy practices, translanguaging support strategies, critical questions relevant to the provision of effective interventions, as well as use of accommodations, modifications and compensatory strategies for improvement of bilingual students’ performance in social and academic settings.

Comprehensive Literacy Checklist For School-Aged Children was created to assist Speech Language Pathologists (SLPs) in the decision-making process of how to identify deficit areas and select assessment instruments to prioritize a literacy assessment for school aged children. The goal is to eliminate administration of unnecessary or irrelevant tests and focus on the administration of instruments directly targeting the specific areas of difficulty that the student presents with.

You can find these and other products in my online store (HERE). Wishing all of you a highly successful and rewarding school year!

Image result for happy school year

Posted on

The Importance of Narrative Assessments in Speech Language Pathology (Revised)

Image result for narrativeA few years ago I wrote a guest post on the importance of assessing narratives for another blog. Below is a revised version of that post containing the updates with respect to the assessment of narratives.

As SLPs we routinely administer a variety of testing batteries in order to assess our students’ speech-language abilities. Grammar, syntax, vocabulary, and sentence formulation get frequent and thorough attention. But how about narrative production? Does it get its fair share of attention when the clinicians are looking to determine the extent of the child’s language deficits? I was so curious about what the clinicians across the country were doing that in 2013, I created a survey and posted a link to it in several SLP-related FB groups.  I wanted to find out how many SLPs were performing narrative assessments, in which settings, and with which populations.  From those who were performing these assessments, I wanted to know what type of assessments were they using and how they were recording and documenting their findings.   Since the purpose of this survey was non-research based (I wasn’t planning on submitting a research manuscript with my findings), I only analyzed the first 100 responses (the rest were very similar in nature) which came my way, in order to get the general flavor of current trends among clinicians, when it came to narrative assessments. Here’s a brief overview of my [limited] findings. Continue reading The Importance of Narrative Assessments in Speech Language Pathology (Revised)

Posted on

Treatment of Children with “APD”: What SLPs Need to Know

Free stock photo of people, woman, cute, playingIn recent years there has been an increase in research on the subject of diagnosis and treatment of Auditory Processing Disorders (APD), formerly known as Central Auditory Processing Disorders or CAPD.

More and more studies in the fields of audiology and speech-language pathology began confirming the lack of validity of APD as a standalone (or useful) diagnosis. To illustrate, in June 2015, the American Journal of Audiology published an article by David DeBonis entitled: “It Is Time to Rethink Central Auditory Processing Disorder Protocols for School-Aged Children.” In this article, DeBonis pointed out numerous inconsistencies involved in APD testing and concluded that “routine use of APD test protocols cannot be supported” and that [APD] “intervention needs to be contextualized and functional” (DeBonis, 2015, p. 124)

Image result for time to rethink quotesFurthermore, in April 2017, an article entitled: “AAA (2010) CAPD clinical practice guidelines: need for an update” (also written by DeBonnis) concluded that the “AAA CAPD guidance document will need to be updated and re-conceptualised in order to provide meaningful guidance for clinicians” due to the fact that the “AAA document … does not reflect the current literature, fails to help clinicians understand for whom auditory processing testing and intervention would be most useful, includes contradictory suggestions which reduce clarity and appears to avoid conclusions that might cast the CAPD construct in a negative light. It also does not include input from diverse affected groups. All of these reduce the document’s credibility.” 

Image result for systematic reviewIn April 2016, de Wit and colleagues published a systematic review in the Journal of Speech, Language, and Hearing ResearchThey reviewed research studies which described the characteristics of APD in children to determine whether these characteristics merited a label of a distinct clinical disorder vs. being representative of other disorders.  After a search of 6 databases, they chose 48 studies which satisfied appropriate inclusion criteria. Unfortunately, they unearthed only one study with strong methodological quality. Even more disappointing was that the children in these studies presented with incredibly diverse symptomology. The authors concluded that “The listening difficulties of children with APD may be a consequence of cognitive, language, and attention issues rather than bottom-up auditory processing” (de Wit et al., 2016, p. 384).  In other words, none of the reviewed studies had conclusively proven that APD was a distinct clinical disorder.  Instead, these studies showed that the children diagnosed with APD exhibited language-based deficits. In other words, the diagnosis of APD did not reveal any new information regarding the child beyond the fact that s/he is in great need of a comprehensive language assessment in order to determine which language-based interventions s/he would optimally benefit from.

Now, it is important to reiterate that students diagnosed with “APD” present with legitimate symptomology (e.g., difficulty processing language, difficulty organizing narratives, difficulty decoding text, etc.). However, all the research to date indicates that these symptoms are indicative of broader language-based deficits, which require targeted language/literacy-based interventions rather than recommendations for specific prescriptive programs (e.g., CAPDOTS, Fast ForWord, etc.) or mere in-school accommodations.

Image result for dig deeper quotesUnfortunately, on numerous occasions when the students do receive the diagnosis of APDthe testing does not “dig further,” which leads to many of them not receiving appropriate comprehensive language-literacy assessments.  Furthermore, APD then becomes the “primary” diagnosis for the student, which places SLPs in situations in which they must address inappropriate therapeutic targets based on an audiologist’s recommendations.  Even worse, in many of these situations, the diagnosis of APD limits the provision of appropriate language-based services to the student.

Since the APD controversy has been going on for years with no end in sight despite the mounting evidence pointing to the lack of its validity, we know that SLPs will continue to have students on their caseloads diagnosed with APD. Thus, the aim of today’s post is to offer some constructive suggestions for SLPs who are asked to assess and treat students with “confirmed” or suspected APD.

The first suggestion comes directly from Dr. Alan Kamhi, who states: “Do not assume that a child who has been diagnosed with APD needs to be treated any differently than children who have been diagnosed with language and learning disabilities” (Kamhi, 2011, p. 270).  In other words, if one carefully analyzes the child’s so-called processing issues, one will quickly realize that those issues are not related to the processing of auditory input  (auditory domain) since the child is not processing tones, hoots, or clicks, etc. but rather has difficulty processing speech and language (language domain).

If a student with confirmed or suspected APD is referred to an SLP, it is important, to begin with formal and informal assessments of language and literacy knowledge and skills. (details HERE)   SLPs need to “consider non-auditory reasons for listening and comprehension difficulties, such as limitations in working memory, language knowledge, conceptual abilities, attention, and motivation (Kamhi & Wallach, 2012).

Image result for language goalsAfter performing a comprehensive assessment, SLPs need to formulate language goals based on determined areas of weaknesses. Please note that a systematic review by Fey and colleagues (2011) found no compelling evidence that auditory interventions provided any unique benefit to auditory, language, or academic outcomes for children with diagnoses of (C)APD or language disorder. As such it’s important to avoid formulating goals focused on targeting isolated processing abilities like auditory discrimination, auditory sequencing, recognizing speech in noise, etc., because these processing abilities have not been shown to improve language and literacy skills (Fey et al., 2011; Kamhi, 2011).

Instead, SLPs need to target we need to focus on the language underpinnings of the above skills and turn them into language and literacy goals. For example, if the child has difficulty recognizing speech in noise, improve the child’s knowledge and access to specific vocabulary words.  This will help the child detect the word when the auditory information is degraded.  Child presents with phonemic awareness deficits? Figure out where in the hierarchy of phonemic awareness their strengths and weaknesses lie and formulate goals based on the remaining areas in need of mastery.  Received a description of the child’s deficits from the audiologist in an accompanying report? Turn them into language goals as well!  Turn “prosodic deficits” or difficulty understanding the intent of verbal messages into “listening for details and main ideas in stories” goals.   In other words, figure out the language correlate to the ‘auditory processing’ deficit and replace it.

Image result for quackeryIt is easy to understand the appeal of using dubious practices which promise a quick fix for our student’s “APD deficits” instead of labor-intensive language therapy sessions. But one must also keep something else in mind as well:   Acquiring higher order language abilities takes a significant period of time, especially for those students whose skills and abilities are significantly below age-matched peers.

APD Summary 

  1. There is still no compelling evidence that APD is a stand-alone diagnosis with clear diagnostic criteria.
  2. There is still no compelling evidence that auditory deficits are a “significant risk factor for  language or academic performance.”
  3. There is still no compelling evidence that “auditory interventions provide any unique benefit to auditory, language, or academic outcomes” (Hazan, Messaoud-Galusi, Rosan, Nouwens, & Shakespeare, 2009; Watson & Kidd, 2009).
  4. APD deficits are language based deficits which accompany a host of developmental conditions ranging from developmental language disorders to learning disabilities, etc.
  5. SLPs should perform comprehensive language and literacy assessments of children diagnosed with APD.
  6. SLPs should target   literacy goals.
  7. SLPS should be wary of any goals or recommendations which focus on remediation of isolated skills such as: “auditory discrimination, auditory sequencing, phonological memory, working memory, or rapid serial naming” since studies have definitively confirmed their lack of effectiveness (Fey et al., 2011).
  8. SLPs should be wary of any prescriptive programs offering APD “interventions” and instead focus on improving children’s abilities for functional communication including listening, speaking, reading, and writing (see Wallach, 2014: Improving Clinical Practice: A School-Age and School-Based Perspective).  This article  “presents a conceptual framework for intervention at school-age levels” and discusses “advanced levels of language that move beyond preschool and early elementary grade goals and objectives with a focus on comprehension and meta-abilities.”

There you have it!  Students diagnosed with APD are best served by targeting the language and literacy problems that are affecting their performance in school. 

Related Posts:

 

 

Posted on

A Focus on Literacy

Image result for literacyIn recent months, I have been focusing more and more on speaking engagements as well as the development of products with an explicit focus on assessment and intervention of literacy in speech-language pathology. Today I’d like to introduce 4 of my recently developed products pertinent to assessment and treatment of literacy in speech-language pathology.

First up is the Comprehensive Assessment and Treatment of Literacy Disorders in Speech-Language Pathology

which describes how speech-language pathologists can effectively assess and treat children with literacy disorders, (reading, spelling, and writing deficits including dyslexia) from preschool through adolescence.  It explains the impact of language disorders on literacy development, lists formal and informal assessment instruments and procedures, as well as describes the importance of assessing higher order language skills for literacy purposes. It reviews components of effective reading instruction including phonological awareness, orthographic knowledge, vocabulary awareness,  morphological awareness, as well as reading fluency and comprehension. Finally, it provides recommendations on how components of effective reading instruction can be cohesively integrated into speech-language therapy sessions in order to improve literacy abilities of children with language disorders and learning disabilities.

from wordless books to readingNext up is a product entitled From Wordless Picture Books to Reading Instruction: Effective Strategies for SLPs Working with Intellectually Impaired StudentsThis product discusses how to address the development of critical thinking skills through a variety of picture books utilizing the framework outlined in Bloom’s Taxonomy: Cognitive Domain which encompasses the categories of knowledge, comprehension, application, analysis, synthesis, and evaluation in children with intellectual impairments. It shares a number of similarities with the above product as it also reviews components of effective reading instruction for children with language and intellectual disabilities as well as provides recommendations on how to integrate reading instruction effectively into speech-language therapy sessions.

Improving critical thinking via picture booksThe product Improving Critical Thinking Skills via Picture Books in Children with Language Disorders is also available for sale on its own with a focus on only teaching critical thinking skills via the use of picture books.

Best Practices in Bilingual LiteracyFinally,   my last product Best Practices in Bilingual Literacy Assessments and Interventions focuses on how bilingual speech-language pathologists (SLPs) can effectively assess and intervene with simultaneously bilingual and multicultural children (with stronger academic English language skills) diagnosed with linguistically-based literacy impairments. Topics include components of effective literacy assessments for simultaneously bilingual children (with stronger English abilities), best instructional literacy practices, translanguaging support strategies, critical questions relevant to the provision of effective interventions, as well as use of accommodations, modifications and compensatory strategies for improvement of bilingual students’ performance in social and academic settings.

You can find these and other products in my online store (HERE).

Helpful Smart Speech Therapy Resources:

Posted on

C/APD Update: New Developments on an Old Controversy

In the past two years, I wrote a series of research-based posts (HERE and HERE) regarding the validity of (Central) Auditory Processing Disorder (C/APD) as a standalone diagnosis as well as questioned the utility of it for classification purposes in the school setting.

Once again I want to reiterate that I was in no way disputing the legitimate symptoms (e.g., difficulty processing language, difficulty organizing narratives, difficulty decoding text, etc.), which the students diagnosed with “CAPD” were presenting with.

Rather, I was citing research to indicate that these symptoms were indicative of broader linguistic-based deficits, which required targeted linguistic/literacy-based interventions rather than recommendations for specific prescriptive programs (e.g., CAPDOTS, Fast ForWord, etc.),  or mere accommodations.

I was also significantly concerned that overfocus on the diagnosis of (C)APD tended to obscure REAL, language-based deficits in children and forced SLPs to address erroneous therapeutic targets based on AuD recommendations or restricted them to a receipt of mere accommodations rather than rightful therapeutic remediation.

Today I wanted to update you regarding new developments, which took place since my last blog post was written 1.5 years ago, regarding the validity of “C/APD” diagnosis.

In April 2016, de Wit and colleagues published a systematic review in the Journal of Speech, Language, and Hearing Research. Their purpose was to review research studies describing the characteristics of APD in children and determine whether these characteristics merited a label of a distinct clinical disorder vs. being representative of other disorders.  After they searched 6 databases they chose 48 studies which satisfied appropriate inclusion criteria. Unfortunately, only 1 study had strong methodological quality and what’s even more disappointing, the children in their studies were very dissimilar and presented with incredibly diverse symptomology. The authors concluded that: “the listening difficulties of children with APD may be a consequence of cognitive, language, and attention issues rather than bottom-up auditory processing.”

In other words, because APD is not a distinct clinical disorder, a diagnosis of APD would not contribute anything to the child’s functioning beyond showing that the child is experiencing linguistically based deficits, which bear further investigation.

To continue, you may remember that in my first CAPD post I extensively cited a tutorial written by Dr. David DeBonis, who is an AuD. In his article, he pointed out numerous inconsistencies involved in CAPD testing and concluded that “routine use of CAPD test protocols cannot be supported” and that [CAPD] “intervention needs to be contextualized and functional.”

In July 2016, Iliadou, Sirimanna, & Bamiou published an article: “CAPD Is Classified in ICD-10 as H93.25 and Hearing Evaluation—Not Screening—Should Be Implemented in Children With Verified Communication and/or Listening Deficits” protesting DeBonis’s claim that CAPD is not a unique clinical entity and as such should not be included in any disease classification system.  They stated that DeBonis omitted the fact that “CAPD is included in the U.S. version of the International Statistical Classification of Diseases and Related Health Problems–10th Revision (ICD-10) under the code H93.25” (p. 368). They also listed what they believed to be a number of article omissions, which they claimed biased DeBonis’s tutorial’s conclusions.

The authors claimed that DeBonis provided a limited definition of CAPD based only on ASHA’s Technical report vs. other sources such as American Academy of Audiology (2010), British Society of Audiology Position Statement (2011), and Canadian Guidelines on Auditory Processing Disorder in Children and Adults: Assessment Intervention (2012).  (p. 368)

The also authors claimed that DeBonis did not adequately define the term “traditional testing” and failed to provide several key references for select claims.  They disagreed with DeBonis’s linkage of certain digit tests, as well as his “lumping” of studies which included children with suspected and diagnosed APD into the same category. (p. 368-9)  They also objected to the fact that he “oversimplified” results of positive gains of select computer-based interventions for APD, and that in his summary section he listed only selected studies pertinent to the topic of intelligence and auditory processing skills. (p. 369).

Their main objection, however, had to do with the section of DeBonis’s article that contained “recommended assessment and intervention process for children with listening and communication difficulties in the classroom”.  They expressed concerns with his recommendations on the grounds that he failed to provide published research to support that this was the optimal way to provide intervention. The authors concluded their article by stating that due to the above-mentioned omissions they felt that DeBonis’s tutorial “show(ed) unacceptable bias” (p. 370).

In response to the Iliadou, Sirimanna, & Bamiou, 2016 concerns, DeBonis issued his own response article shortly thereafter (DeBonis, 2016). Firstly, he pointed out that when his tutorial was released in June 2015 the ICD-10 was not yet in effect (it was enacted Oct 1, 2015). As such his statement was factually accurate.

Secondly, he also made a very important point regarding the C/APD construct validity, namely that it fails to satisfy the Sydenham–Guttentag criteria as a distinct clinical entity (Vermiglio, 2014). Namely, despite attempts at diagnostic uniformity, CAPD remains ambiguously defined, with testing failing to “represent a homogenous patient group.” (p. 906).

For those who are unfamiliar with this terminology (as per direct quote from Dr. Vermiglio’s presentation): “The Sydenham-Guttentag Criteria for the Clinical Entity Proposed by Vermiglio (accepted 2014, JAAA) is as follows:

  1. The clinical entity must possess an unambiguous definition (Sydenham, 1676; FDA, 2000)
  2. It must represent a homogeneous patient group (Sydenham, 1676; Guttentag, 1949, 1950; FDA, 2000)
  3. It must represent a perceived limitation (Guttentag, 1949)
  4. It must facilitate diagnosis and intervention (Sydenham, 1676; Guttentag, 1949; FDA, 2000)

Thirdly, DeBonis addressed Iliadou, Sirimanna, & Bamiou, 2016 concerns that he did not use the most recent definition of APD by pointing out that he was most qualified to discuss the US system and its definitions of CAPD, as well as that “the U.S. guidelines, despite their limitations and age, continue to have a major impact on the approach to auditory processing disorders worldwide” (p.372). He also elucidated that: the AAA’s (2010) definition of CAPD is “not so much built on previous definitions but rather has continued to rely on them” and as such does not constitute a “more recent” source of CAPD definitions. (p.372)

DeBonis next addressed the claim that he did not adequately define the term “traditional testing”. He stated that he defined it on pg. 125 of his tutorial and that information on it was taken directly from the AAA (2010) document. He then explained how it is “aligned with bottom-up aspects of the auditory system” by citing numerous references (see p. 372 for further details).  After that, he addressed Iliadou, Sirimanna, & Bamiou, 2016 claim that he failed to provide references by pointing out the relevant citation in his article, which they failed to see.

Next, he proceeded to address their concerns “regarding the interaction between cognition and auditory processing” by reiterating that auditory processing testing is “not so pure” and is affected by constructs such as memory, executive function skills, etc. He also referenced the findings of  Beck, Clarke and Moore (2016)  that “most currently used tests of APD are tests of language and attention…lack sensitivity and specificity” (p. 27).

The next point addressed by DeBonis was the use of studies which included children with suspected vs. confirmed APD. He agreed that “one cannot make inferences about one population from another” but added that the data from the article in question “provided insight into the important role of attention and memory in children who are poor listeners” and that “such listeners represent the population [which] should be [AuD’s] focus.” (p.373)

From there on, DeBonis moved on to address Iliadou, Sirimanna, & Bamiou, 2016 claims that he “oversimplified” the results of one CBAT study dealing with effects of computer-based interventions for APD. He responded that the authors of that review themselves stated that: “the evidence for improving phonological awareness is “initial”.

Consequently, “improvements in auditory processing—without subsequent changes in the very critical tasks of reading and language—certainly do not represent an endorsement for the auditory training techniques that were studied.” (p.373)

Here, DeBonis also raised concerns regarding the overall concept of treatment effectiveness, stating that it should not be based on “improved performance on behavioral tests of auditory processing or electrophysiological measures” but ratheron improvements on complex listening and academic tasks“. (p.373) As such,

  1. “This limited definition of effectiveness leads to statements about the impact of certain interventions that can be misinterpreted at best and possibly misleading.”
  2. “Such a definition of effectiveness is unlikely to be satisfying to working clinicians or parents of children with communication difficulties who hope to see changes in day-to-day communication and academic abilities.” (p.373)

Then, DeBonis addressed Iliadou, Sirimanna, & Bamiou, 2016 concerns regarding the omission of an article supporting CAPD and intelligence as separate entities. He reiterated that the aim of his tutorial was to note that “performance on commonly used tests of auditory processing is highly influenced by a number of cognitive and linguistic factors” rather than to “do an overview of research in support of and in opposition to the construct”. (p.373)

Subsequently, DeBonis addressed the Iliadou, Sirimanna, & Bamiou, 2016 claim that he did not provide research to support his proposed testing protocol, as well as that he made a figure error. He conceded that the authors were correct with respect to the figure error (the information provided in the figure was not sufficient). However, he pointed out that the purpose of his tutorial was to “to review the literature related to ongoing concerns about the use of the CAPD construct in school-aged children and to propose an alternative assessment/intervention procedure that moves away from testing “auditory processing” and moves toward identifying and supporting students who have listening challenges”. As such, while the effectiveness of his model is being tested, it makes sense to “use of questionnaires and speech-in-noise tests with very strong psychometric characteristics” and thoroughly assess these children’s “language and cognitive skills to reduce the chance of misdiagnosis”  in order to provide functional interventions (p.373).

Finally, Debonis addressed the Iliadou, Sirimanna, & Bamiou, 2016 accusation that his tutorial contained “unacceptable bias”. He pointed out that “the reviewers of this [his 2015 article article] did not agree” and that since the time of that article’s publication “readers and other colleagues have viewed it as a vehicle for important thought about how best to help children who have listening difficulties.” (p. 374)

Having read the above information, many of you by now must be wondering: “Why is the research on APD as a valid stand alone diagnosis continues to be published at regular intervals?”

To explain the above phenomenon, I will use several excerpts from an excellent presentation by Kamhi, A, Vermiglio, A, & Wallach, G (2016), which I attended during the 2016 ASHA Convention in Philadephia, PA.

It has been suggested that the above has to do with: “The bias of the CAPD Convention Committee that reviews submissions.” Namely, “The committee only accepts submissions consistent with the traditional view of (C)APD espoused by Bellis, Chermak and others who wrote the ASHA (2005) position statement on CAPD.”

Kamhi Vermiglio, and Wallach (2016) supported this claim by pointing out that when Dr. Vermiglio attempted to submit his findings on the nature of “C/APD” for the 2015 ASHA Convention, “the committee did not accept Vermiglio’s submission” but instead accepted the following seminar: “APD – It Exists! Differential Diagnosis & Remediation” and allocated for it “a prominent location in the program planner.”

Indeed, during the 2016 ASHA convention alone, there was a host of 1 and 2-hour pro-APD sessions such as: “Yes, You CANS! Adding Therapy for Specific CAPDs to an IEP“, “Perspectives on the Assessment & Treatment of Individuals With Central Auditory Processing Disorder (CAPD)“, as well asThe Buffalo Model for CAPD: Looking Back & Forward, in addition to a host of posters and technical reports attempting to validate this diagnosis despite mounting evidence refuting that very fact. Yet only one session, “Never-Ending Controversies With CAPD: What Thinking SLPs & Audiologists Know” presented by Kamhi, Vermiglio, & Wallach (two SLPs and one AuD) and accepted by a non-AuD committee, discussed the current controversies raging in the fields of speech pathology and audiology pertaining to “C/APD”. 

In 2016, Diane Paul, the Director of Clinical Issues in Speech-Language Pathology at ASHA  had asked Kamhi, Vermiglio, and Wallach “to offer comments on the outline of audiology and SLP roles in assessing and treating CAPD”.  According to Kamhi, et al, 2016, the outline did not mention any of controversies in assessment and diagnosis documented by numerous authors dating as far as 2009. It also did not “mention the lack of evidence on the efficacy of auditory interventions documented in the systematic review by Fey et al. (2011) and DeBonis (2015).”

At this juncture, it’s important to start thinking regarding possible incentives a professional might have to continue performing APD testing and making prescriptive program recommendations despite all the existing evidence refuting the validity and utility of APD diagnosis for children presenting with listening difficulties.

Conclusions:

  • There is still no compelling evidence that APD is a stand-alone diagnosis with clear diagnostic criteria
  • There is still no compelling evidence that auditory deficits are a “significant risk factor for  language or academic performance”
  • There is still no compelling evidence that “auditory interventions provide any unique benefit to auditory, language, or academic outcomes” (Hazan, Messaoud-Galusi, Rosan, Nouwens, & Shakespeare, 2009; Watson & Kidd, 2009)
  • APD deficits are linguistically based deficits which accompany a host of developmental conditions ranging from developmental language disorders to learning disabilities, etc.
  • SLPs should continue comprehensively assessing children diagnosed with “C/APD” to determine the scope of their linguistic deficits
  • SLPs should continue formulating language goals to  determine linguistic areas of weaknesses
  • SLPS should be wary of any goals or recommendations which focus on remediation of isolated skills such as: “auditory discrimination, auditory sequencing, phonological memory, working memory, or rapid serial naming” since studies have definitively confirmed their lack of effectiveness (Fey, et al, 2011)
  • SLPs should be wary of any prescriptive programs offering C/APD “interventions”
  • SLPs should focus on improving children’s abilities for functional communication including listening, speaking, reading, and writing
    • Please see excellent article written by Dr. Wallach in 2014 entitled: Improving Clinical Practice: A School-Age and School-Based Perspective. It “presents a conceptual framework for intervention at school-age levels” and discusses “advanced levels of language that move beyond preschool and early elementary grade goals and objectives with a focus on comprehension and meta-abilities.”

So there you have it, sadly, despite research and logic, the controversy is very much alive! Except I am seeing some new developments!

I see SLPs, newly-minted and seasoned alike, steadily voicing their concerns regarding the symptomology they are documenting in children diagnosed with so-called “CAPD” as being purely auditory in nature.

I see more and more SLPs supporting research evidence and science by voicing their concerns regarding the numerous diagnostic markers of ‘CAPD’ which do not make sense to them by stating “Wait a second – that can’t be right!”.

I see more and more SLPs documenting the lack of progress children make after being prescribed isolated FM systems or computer programs which claim to treat “APD symptomology” (without provision of therapy services).  I see more and more SLPs beginning to understand the lack of usefulness of this diagnosis, who switch to using language-based interventions to teach children to listen, speak, read and write and to generalize these abilities to both social and academic settings.

I see more and more SLPs beginning to understand the lack of usefulness of this diagnosis, who switch to using language-based interventions to teach children to listen, speak, read and write and to generalize these abilities to both social and academic settings.

So I definitely do see hope on the horizon!

References:

(arranged in chronological order of citation in the blog post):

Related Posts:

 

Posted on

New Product Giveaway: Comprehensive Literacy Checklist For School-Aged Children

I wanted to start the new year right by giving away a few copies of a new checklist I recently created entitled: “Comprehensive Literacy Checklist For School-Aged Children“.

It was created to assist Speech Language Pathologists (SLPs) in the decision-making process of how to identify deficit areas and select assessment instruments to prioritize a literacy assessment for school aged children.

The goal is to eliminate administration of unnecessary or irrelevant tests and focus on the administration of instruments directly targeting the specific areas of difficulty that the student presents with.

*For the purpose of this product, the term “literacy checklist” rather than “dyslexia checklist” is used throughout this document to refer to any deficits in the areas of reading, writing, and spelling that the child may present with in order to identify any possible difficulties the child may present with, in the areas of literacy as well as language.

This checklist can be used for multiple purposes.

1. To identify areas of deficits the child presents with for targeted assessment purposes

2. To highlight areas of strengths (rather than deficits only) the child presents with pre or post intervention

3. To highlight residual deficits for intervention purpose in children already receiving therapy services without further reassessment

Checklist Contents:

  • Page 1 Title
  • Page 2 Directions
  • Pages 3-9 Checklist
  • Page 10 Select Tests of Reading, Spelling, and Writing for School-Aged Children
  • Pages 11-12 Helpful Smart Speech Therapy Materials

Checklist Areas:

  1. AT RISK FAMILY HISTORY
  2. AT RISK DEVELOPMENTAL HISTORY
  3. BEHAVIORAL MANIFESTATIONS 
  4. LEARNING DEFICITS   
    1. Memory for Sequences
    2. Vocabulary Knowledge
    3. Narrative Production
    4. Phonological Awareness
    5. Phonics
    6. Morphological Awareness
    7. Reading Fluency
    8. Reading Comprehension
    9. Spelling
    10. Writing Conventions
    11. Writing Composition 
    12. Handwriting

You can find this product in my online store HERE.

Would you like to check it out in action? I’ll be giving away two copies of the checklist in a Rafflecopter Giveaway to two winners.  So enter today to win your own copy!

a Rafflecopter giveaway

Posted on

How Early can “Dyslexia” be Diagnosed in Children?

Image result for dyslexiaIn recent years there has been a substantial rise in awareness pertaining to reading disorders in young school-aged children. Consequently, more and more parents and professionals are asking questions regarding how early can “dyslexia” be diagnosed in children.

In order to adequately answer this question it is important to understand the trajectory of development of literacy disorders in children.

Image result for ida dyslexiaAccording to the definition set forth by the International Dyslexia Association“Dyslexia is a specific learning disability that is neurobiological in origin. It is characterized by difficulties with accurate and/or fluent word recognition and by poor spelling and decoding abilities. These difficulties typically result from a deficit in the phonological component of language that is often unexpected in relation to other cognitive abilities and the provision of effective classroom instruction. Secondary consequences may include problems in reading comprehension and reduced reading experience that can impede growth of vocabulary and background knowledge.”

Thus, despite the significant controversy over the use of the label “dyslexia”, as being ‘unscientific and conceptually problematic’, the above definition affirms the fact that it is undisputedly a linguistically based disability.   While it is true that merely using the term “dyslexia” does not automatically evoke our understanding of what type of specific reading-related deficits the child is experiencing, which prevents him/her from reading effectively, it does alert us right away to the fact that a reading disability exists.

In this post, rather than utilizing the term “dyslexia”, I will use a more broad term “literacy deficits” to refer to children who develop trouble reading, writing, and spelling.

Image result for genetic inheritanceSo who exactly are those children? Well, with respect to genetic inheritance, children with immediate and/or extended family members who have in the past received diagnoses such as “dyslexia”, “reading disability”, “learning disability” or who had experienced special education placements during school years are significantly more at risk of developing literacy based deficits than children with no history of above problems in the family.

Unfortunately, the situation is further complicated by the fact that some children with no recognizable family history of learning disabilities, may be at risk for future literacy deficits if they display a pattern of linguistic difficulties during early development (e.g., delayed developmental milestones).

Below is the approximate hierarchy of language development in young children:

  • Exploration of the environment (early socio-emotional development)
  • Play (continuation of socio-emotional development)
  • Receptive Language
    • Comprehension of  words, phrases, sentences, stories
  • Expressive Language
    • Speaking single words, phrases, sentences, engaging in conversations, producing stories
  • Social Emotional Development (Pragmatics) continues to be refined and becomes more sophisticated
  • Reading
    • Words, sentences, short stories, chapter books, etc.
    • General topics
    • Domain specific topics (science, social studies, etc)
  • Spelling
  •  Writing
    • Words, sentences, short stories, essays

The fact is that if the child experiences any deficits in the foundational language areas such as listening and speaking, s/he will most certainly experience difficulties in more complex areas of language: reading, writing, and spelling.

So now that we know that children with a history of language delay/disorder are at a significant risk of having the disorder turn into a learning disability when they’re older, let’s talk about how early can these children be assessed in order to better plan their future literacy based interventions for optimal functional outcomes.

The first scenario is a more obvious one.  If a child has a documented history of language impairments and is receiving services from a very early age (e.g., early intervention, preschool, etc.) then given what we know about the connection between language disorders and learning disabilities, professionals can begin administering phonological awareness/emergent reading interventions during the early preschool years in order to optimally facilitate the child’s literacy outcomes.

Image result for detective clipartNow our second scenario is not so clear-cut. In our second scenario, the child may have never been identified as having language difficulties during toddlerhood or even early preschool years. However, as the child grows older (e.g., 4-5 years of age) his/her parents may be noticing some subtle difficulties such as difficulty remembering nursery rhymes and songs, trouble remembering the letters of the alphabet, trouble recognizing simple rhyming words, etc.  A such, even without a pertinent family history of literacy disabilities it may be important for a child to undergo an early literacy assessment in order to determine whether intervention is warranted.

Now let’s talk about various assessment options available for preschool children with suspected literacy deficits.  Firstly, if the child has never received a language assessment it is paramount that the child’s language abilities in the areas of listening comprehension, verbal expression, problem-solving and social communication be assessed prior to assessment of literacy  to ensure that the child does not present with any unrecognized/previously undetected deficits in any of the above areas.  This is done in order to ensure optimal intervention outcomes as failure to address gaps/deficits in foundational language areas may significantly impede any potential literacy gains even when the child is provided with optimal literacy based interventions (click HERE to view my post discussing select speech-language tests for preschool children 2-6 years of age).

Now that we’ve covered some basics let us move on to discuss how early can select literacy tests be administered.  Luckily, there are a number of tests pertaining to literacy which can be administered to children as young as 3:6 years of age.

Image result for asa pearsonTo illustrate: The Auditory Skills Assessment (ASA) can be administered to children 3:6—6:11 years of age. Present controversy over CAPD notwithstanding, it does assess important areas related to early phonological awareness development including nonsense word repetition, phonemic blending, as well as rhyming.  Similarly, the Test of Auditory Processing Skills-3 (TAPS-3) begins at 4 years of age and covers several areas pertaining to phonological awareness including auditory discrimination of words, phonological segmentation, as well as phonological blending abilities.

Image result for ctoppHowever, for a thorough phonological awareness assessment for children that age (4+) nothing beats the Comprehensive Test of Phonological Processing-2 —(CTOPP-2), which assesses such areas as:

  • Phonological Segmentation
  • Blending Words
  • Sound Matching
  • Initial, Medial and Final Phoneme Isolation
  • Blending Nonwords*
  • Segmenting Nonwords*
  • Memory for Digits
  • Nonword Repetition*
  • Rapid Digit Naming 
  • Rapid Letter Naming 
  • Rapid Color Naming 
  • Rapid Object Naming 

(—Assesses the ability to manipulate real and *nonsense words)

(—Assesses word fluency skills via a host of rapid naming tasks)

Image result for Emerging Literacy & Language Assessment®For children 4:6 years of age and older the  Emerging Literacy & Language Assessment (ELLA) deserves a mention. It assesses the following literacy related abilities:

  • Section 1 – Phonological Awareness and Flexibility assesses rhyming (awareness and production), initial sound identification, blending and segmenting sounds, words, and syllables, and deleting and substituting sounds in the initial and final positions of words.
  • Section 2 – Sign and Symbol Recognition and Interpretation assesses environmental symbol identification, letter-symbol identification, word reference association, and reading comprehension for one to three sentences.
  • Section 3 – Memory, Retrieval, and Automaticity assesses rapid naming, word associations (name items that start with the “S” sound), and story retell (includes three story levels based on the child’s age).

For children between 5:0-9:11 years of age, —The Phonological Awareness Test 2 (PAT 2) will assess the following areas:Product Image

  • —Rhyming:  Discrimination and Production—identify rhyming pairs and provide a rhyming word
  • —Segmentation:  Sentences, Syllables, and Phonemes—dividing by words, syllables and phonemes
  • —Isolation:  Initial, Final, Medial—identify sound position in words
  • —Deletion:  Compound Words, Syllables, and Phonemes—manipulate root words, syllables, and phonemes in words
  • —Substitution With Manipulatives—isolate a phoneme in a word, then change it to another phoneme to form a new word
  • —Blending:  Syllables and Phonemes—blend units of sound together to form words
  • —Graphemes—assess knowledge of sound/symbol correspondence for consonants, vowels, consonant blends, consonant digraphs, r-controlled vowels, vowel digraphs, and diphthongs
  • —Decoding—assess  general knowledge of sound/symbol correspondence to blend sounds into nonsense words
  • —Invented Spelling (optional)—write words to dictation to show encoding ability

Furthermore, starting from 5 years of age the —Rapid Automatized Naming and Rapid Alternating Stimulus Test RAN/RAS  tests can be administered in order to assess the child’s word fluency skills.  Decreased word fluency is a significant indicator of reading deficits, which is why this ability is very important to test.

—In addition to the above assessments, there are several tests of early reading and writing abilities which are available for younger children with suspected literacy deficits

TERA-3: Test of Early Reading Ability–Third EditionThe  Test of Early Reading Ability–Third Edition (TERA-3) assesses  the emergent reading abilities of children starting from 3:6 years of age. Similarly, the Test of Early Written Language, Third Edition (TEWL-3) assesses  the emergent writing abilities of children starting from 4:0 years of age.

So there you have it! Now you know that if needed children as young 3:6 years of age can undergo early literacy assessments in order to determine their potential risk of developing literacy deficits when older.

Of course, due to the precociously young age of the children, it is important for examiners to exercise significant caution when it comes to interpretation of standardized testing results. It is a well-documented fact that standardized tests present with numerous limitations when it comes to identification of children with language and literacy disorders.

As such, due to the children’s young age there will be a number of instances when testing may reveal “false negative results” (show that there are no deficits when deficits still exist).  Consequently, in such cases, it is important to carefully monitor the child’s school performance in order to perform a literacy reassessment (if needed) when the child is older and his/her difficulties may be more apparent (click HERE to view my 4-part post discussing Components of Comprehensive Dyslexia Testing for further details).

Finally, it is very important to reiterate that children presenting with language and literacy deficits will not outgrow these deficits on their own. While there may be periods of “illusory recovery” when it looks like children with early language disorders have caught up with their peers, such “spurts” are typically followed by a “post-spurt plateau” (Sun & Wallach, 2014). This is because due to the ongoing challenges and an increase in academic demands “many children with early language disorders fail to “outgrow” these difficulties or catch up with their typically developing peers” (Sun & Wallach, 2014).  That is why it is crucial that we identify language and literacy deficits in children at a very early age in order to ensure their optimal educational outcomes.

Related Posts:

Helpful Smart Speech Therapy Resources Pertaining to Preschoolers: 

Posted on

Comprehensive Assessment of Adolescents with Suspected Language and Literacy Disorders

When many of us think of such labels as “language disorder” or “learning disability”, very infrequently do adolescents (students 13-18 years of age) come to mind. Even today, much of the research in the field of pediatric speech pathology involves preschool and school-aged children under 12 years of age.

The prevalence and incidence of language disorders in adolescents is very difficult to estimate due to which some authors even referred to them as a Neglected Group with Significant Problems having an “invisible disability“.

Far fewer speech language therapists work with middle-schoolers vs. preschoolers and elementary aged kids, while the numbers of SLPs working with high-school aged students is frequently in single digits in some districts while being completely absent in others. In fact, I am frequently told (and often see it firsthand) that some administrators try to cut costs by attempting to dictate a discontinuation of speech-language services on the grounds that adolescents “are far too old for services” or can “no longer benefit from services”.  

But of course the above is blatantly false. Undetected language deficits don’t resolve with age! They simply exacerbate and turn into learning disabilities. Similarly, lack of necessary and appropriate service provision to children with diagnosed language impairments  at the middle-school and high-school levels will strongly affect their academic functioning and hinder their future vocational outcomes.

A cursory look at the Speech Pathology Related  Facebook Groups as well as ASHA forums reveals numerous SLPs in a continual search for best methods of assessment and treatment of older students (~12-18 years of age).  

Consequently, today I wanted to dedicate this post to a review of standardized assessments options available for students 12-18 years of age with suspected language and literacy deficits.

Most comprehensive standardized assessments, “typically focus on semantics, syntax, morphology, and phonology, as these are the performance areas in which specific skill development can be most objectively measured” (Hill & Coufal, 2005, p 35). Very few of them actually incorporate aspects of literacy into its subtests in a meaningful way.  Yet by the time students reach adolescence literacy begins to play an incredibly critical role not just in all the aspects of academics but also social communication.

So when it comes to comprehensive general language testing I highly recommended that SLPs select  standardized measures with a focus on not  language but also literacy.  Presently of all the comprehensive assessment tools   I highly prefer the Test of Integrated Language and Literacy (TILLS) for students up to 18 years of age, (see a comprehensive review HERE),  which covers such literacy areas as phonological awareness, reading fluency, reading comprehension, writing and spelling in addition to traditional language areas as as vocabulary awareness, following directions, story recall, etc. However,  while comprehensive tests have  numerous  uses,  their sole  administration will not constitute an adequate assessment.

So what areas should be assessed during language and literacy testing?  Below are  a few suggestions of standardized testing measures (and informal procedures) aimed at exploring the student abilities in particular areas pertaining to language and literacy.

TESTS OF LANGUAGE

TESTS OF LITERACYscreen-shot-2016-10-09-at-2-29-57-pm

It is understandable  how given the sheer amount of assessment choices some clinicians may feel overwhelmed and be unsure regarding the starting point of an adolescent evaluation.   Consequently, the use the checklist prior to the initiation of assessment may be highly useful in order to identify potential language weaknesses/deficits the students might experience. It will also allow clinicians to prioritize  the hierarchy of testing instruments to use during the assessment.  

While clinicians are encouraged to develop such checklists for their personal use,  those who lack time and opportunity can locate a number of already available checklists on the market. 

For example, the comprehensive 6-page Speech Language Assessment Checklist for Adolescents (below) can be given to caregivers, classroom teachers, and even older students in order to check off the most pressing difficulties the student is experiencing in an academic setting. 

adolescent checklist

It is important for several individuals to fill out this checklist to ensure consistency of deficits, prior to determining whether an assessment is warranted in the first place and if so, which assessment areas need to be targeted.

Checklist Categories:

  1. Receptive Language
  2. Memory, Attention and Cognition
  3. Expressive Language
  4. Vocabulary
  5. Discourse
  6. Speech
  7. Voice
  8. Prosody
  9. Resonance
  10. Reading
  11. Writing
  12. Problem Solving
  13. Pragmatic Language Skills
  14. Social Emotional Development
  15. Executive Functioning

alolescent pages sample

Based on the checklist administration SLPs can  reliably pinpoint the student’s areas of deficits without needless administration of unrelated/unnecessary testing instruments.  For example, if a student presents with deficits in the areas of problem solving and social pragmatic functioning the administration of a general language test such as the Clinical Evaluation of Language Fundamentals® – Fifth Edition (CELF-5) would NOT be functional (especially if the previous administration of educational testing did not reveal any red flags). In contrast, the administration of such tests as Test Of Problem Solving 2 Adolescent and Social Language Development Test Adolescent would be better reflective of the student’s deficits in the above areas. (Checklist HERE; checklist sample HERE). 

It is very important to understand that students presenting with language and literacy deficits will not outgrow these deficits on their own. While there may be “a time period when the students with early language disorders seem to catch up with their typically developing peers” (e.g., illusory recovery) by undergoing a “spurt” in language learning”(Sun & Wallach, 2014). These spurts are typically followed by a “post-spurt plateau”. This is because due to the ongoing challenges and an increase in academic demands “many children with early language disorders fail to “outgrow” these difficulties or catch up with their typically developing peers”(Sun & Wallach, 2014).  As such many adolescents “may not show academic or language-related learning difficulties until linguistic and cognitive demands of the task increase and exceed their limited abilities” (Sun & Wallach, 2014).  Consequently, SLPs must consider the “underlying deficits that may be masked by early oral language development” and “evaluate a child’s language abilities in all modalities, including pre-literacy, literacy, and metalinguistic skills” (Sun & Wallach, 2014).

References:

  1. Hill, J. W., & Coufal, K. L. (2005). Emotional/behavioral disorders: A retrospective examination of social skills, linguistics, and student outcomes. Communication Disorders Quarterly27(1), 33–46.
  2. Sun, L & Wallach G (2014) Language Disorders Are Learning Disabilities: Challenges on the Divergent and Diverse Paths to Language Learning Disability. Topics in Language Disorders, Vol. 34; (1), pp 25–38.

Helpful Smart Speech Therapy Resources 

  1. Assessment of Adolescents with Language and Literacy Impairments in Speech Language Pathology 
  2. Assessment and Treatment Bundles 
  3. Social Communication Materials
  4. Multicultural Materials 

 

Posted on

Review of the Test of Integrated Language and Literacy (TILLS)

The Test of Integrated Language & Literacy Skills (TILLS) is an assessment of oral and written language abilities in students 6–18 years of age. Published in the Fall 2015, it is  unique in the way that it is aimed to thoroughly assess skills  such as reading fluency, reading comprehension, phonological awareness,  spelling, as well as writing  in school age children.   As I have been using this test since the time it was published,  I wanted to take an opportunity today to share just a few of my impressions of this assessment.

               

First, a little background on why I chose to purchase this test  so shortly after I had purchased the Clinical Evaluation of Language Fundamentals – 5 (CELF-5).   Soon after I started using the CELF-5  I noticed that  it tended to considerably overinflate my students’ scores  on a variety of its subtests.  In fact,  I noticed that unless a student had a fairly severe degree of impairment,  the majority of his/her scores  came out either low/slightly below average (click for more info on why this was happening HERE, HEREor HERE). Consequently,  I was excited to hear regarding TILLS development, almost simultaneously through ASHA as well as SPELL-Links ListServe.   I was particularly happy  because I knew some of this test’s developers (e.g., Dr. Elena Plante, Dr. Nickola Nelson) have published solid research in the areas of  psychometrics and literacy respectively.

According to the TILLS developers it has been standardized for 3 purposes:

  • to identify language and literacy disorders
  • to document patterns of relative strengths and weaknesses
  • to track changes in language and literacy skills over time

The testing subtests can be administered in isolation (with the exception of a few) or in its entirety.  The administration of all the 15 subtests may take approximately an hour and a half, while the administration of the core subtests typically takes ~45 mins).

Please note that there are 5 subtests that should not be administered to students 6;0-6;5 years of age because many typically developing students are still mastering the required skills.

  • Subtest 5 – Nonword Spelling
  • Subtest 7 – Reading Comprehension
  • Subtest 10 – Nonword Reading
  • Subtest 11 – Reading Fluency
  • Subtest 12 – Written Expression

However,  if needed, there are several tests of early reading and writing abilities which are available for assessment of children under 6:5 years of age with suspected literacy deficits (e.g., TERA-3: Test of Early Reading Ability–Third Edition; Test of Early Written Language, Third Edition-TEWL-3, etc.).

Let’s move on to take a deeper look at its subtests. Please note that for the purposes of this review all images came directly from and are the property of Brookes Publishing Co (clicking on each of the below images will take you directly to their source).

TILLS-subtest-1-vocabulary-awareness1. Vocabulary Awareness (VA) (description above) requires students to display considerable linguistic and cognitive flexibility in order to earn an average score.    It works great in teasing out students with weak vocabulary knowledge and use,   as well as students who are unable to  quickly and effectively analyze  words  for deeper meaning and come up with effective definitions of all possible word associations. Be mindful of the fact that  even though the words are presented to the students in written format in the stimulus book, the examiner is still expected to read  all the words to the students. Consequently,  students with good vocabulary knowledge  and strong oral language abilities  can still pass this subtest  despite the presence of significant reading weaknesses. Recommendation:  I suggest informally  checking the student’s  word reading abilities  by asking them to read of all the words, before reading all the word choices to them.   This way  you can informally document any word misreadings  made by the student even in the presence of an average subtest score.

TIILLS-subtest-2-phonemic-awareness

2. The Phonemic Awareness (PA) subtest (description above) requires students to  isolate and delete initial sounds in words of increasing complexity.  While this subtest does not require sound isolation and deletion in various word positions, similar to tests such as the CTOPP-2: Comprehensive Test of Phonological Processing–Second Edition  or the The Phonological Awareness Test 2 (PAT 2)  it is still a highly useful and reliable measure of  phonemic awareness (as one of many precursors to reading fluency success).  This is especially because after the initial directions are given, the student is expected to remember to isolate the initial sounds in words without any prompting from the examiner.  Thus,  this task also  indirectly tests the students’ executive function abilities in addition to their phonemic awareness skills.

TILLS-subtest-3-story-retelling

3. The Story Retelling (SR) subtest (description above) requires students to do just that retell a story. Be mindful of the fact that the presented stories have reduced complexity. Thus, unless the students possess  significant retelling deficits, the above subtest  may not capture their true retelling abilities. Recommendation:  Consider supplementing this subtest  with informal narrative measures. For younger children (kindergarten and first grade) I recommend using wordless picture books to perform a dynamic assessment of their retelling abilities following a clinician’s narrative model (e.g., HERE).  For early elementary aged children (grades 2 and up), I recommend using picture books, which are first read to and then retold by the students with the benefit of pictorial but not written support. Finally, for upper elementary aged children (grades 4 and up), it may be helpful for the students to retell a book or a movie seen recently (or liked significantly) by them without the benefit of visual support all together (e.g., HERE).

TILLS-subtest-4-nonword-repetition

4. The Nonword Repetition (NR) subtest (description above) requires students to repeat nonsense words of increasing length and complexity. Weaknesses in the area of nonword repetition have consistently been associated with language impairments and learning disabilities due to the task’s heavy reliance on phonological segmentation as well as phonological and lexical knowledge (Leclercq, Maillart, Majerus, 2013). Thus, both monolingual and simultaneously bilingual children with language and literacy impairments will be observed to present with patterns of segment substitutions (subtle substitutions of sounds and syllables in presented nonsense words) as well as segment deletions of nonword sequences more than 2-3 or 3-4 syllables in length (depending on the child’s age).

TILLS-subtest-5-nonword-spelling

5. The Nonword Spelling (NS) subtest (description above) requires the students to spell nonwords from the Nonword Repetition (NR) subtest. Consequently, the Nonword Repetition (NR) subtest needs to be administered prior to the administration of this subtest in the same assessment session.  In contrast to the real-word spelling tasks,  students cannot memorize the spelling  of the presented words,  which are still bound by  orthographic and phonotactic constraints of the English language.   While this is a highly useful subtest,  is important to note that simultaneously bilingual children may present with decreased scores due to vowel errors.   Consequently,  it is important to analyze subtest results in order to determine whether dialectal differences rather than a presence of an actual disorder is responsible for the error patterns.

TILLS-subtest-6-listening-comprehension

6. The  Listening Comprehension (LC) subtest (description above) requires the students to listen to short stories  and then definitively answer story questions via available answer choices, which include: “Yes”, “No’, and “Maybe”. This subtest also indirectly measures the students’ metalinguistic awareness skills as they are needed to detect when the text does not provide sufficient information to answer a particular question definitively (e.g., “Maybe” response may be called for).  Be mindful of the fact that because the students are not expected to provide sentential responses  to questions it may be important to supplement subtest administration with another listening comprehension assessment. Tests such as the Listening Comprehension Test-2 (LCT-2), the Listening Comprehension Test-Adolescent (LCT-A),  or the Executive Function Test-Elementary (EFT-E)  may be useful  if  language processing and listening comprehension deficits are suspected or reported by parents or teachers. This is particularly important  to do with students who may be ‘good guessers’ but who are also reported to present with word-finding difficulties at sentence and discourse levels. 

TILLS-subtest-7-reading-comprehension

7. The Reading Comprehension (RC) subtest (description above) requires the students to  read short story and answer story questions in “Yes”, “No’, and “Maybe”  format.   This subtest is not stand alone and must be administered immediately following the administration the Listening Comprehension subtest. The student is asked to read the first story out loud in order to determine whether s/he can proceed with taking this subtest or discontinue due to being an emergent reader. The criterion for administration of the subtest is making 7 errors during the reading of the first story and its accompanying questions. Unfortunately,  in my clinical experience this subtest  is not always accurate at identifying children with reading-based deficits.

While I find it terrific for students with severe-profound reading deficits and/or below average IQ, a number of my students with average IQ and moderately impaired reading skills managed to pass it via a combination of guessing and luck despite being observed to misread aloud between 40-60% of the presented words. Be mindful of the fact that typically  such students may have up to 5-6  errors during the reading of the first story. Thus, according to administration guidelines these students will be allowed to proceed and take this subtest.  They will then continue to make text misreadings  during each story presentation (you will know that by asking them to read each story aloud vs. silently).   However,  because the response mode is in definitive (“Yes”, “No’, and “Maybe”) vs. open ended question format,  a number of these students  will earn average scores by being successful guessers. Recommendation:  I highly recommend supplementing the administration of this subtest with grade level (or below grade level) texts (see HERE and/or HERE),  to assess the student’s reading comprehension informally.

I present a full  one page text to the students and ask them to read it to me in its entirety.   I audio/video record  the student’s reading for further analysis (see Reading Fluency section below).   After the  completion of the story I ask  the student questions with a focus on main idea comprehension and vocabulary definitions.   I also ask questions pertaining to story details.   Depending on the student’s age  I may ask them  abstract/ factual text questions with and without text access.  Overall, I find that informal administration of grade level (or even below grade-level) texts coupled with the administration of standardized reading tests provides me with a significantly better understanding of the student’s reading comprehension abilities rather than administration of standardized reading tests alone.

TILLS-subtest-8-following-directions

8. The Following Directions (FD) subtest (description above) measures the student’s ability to execute directions of increasing length and complexity.  It measures the student’s short-term, immediate and working memory, as well as their language comprehension.  What is interesting about the administration of this subtest is that the graphic symbols (e.g., objects, shapes, letter and numbers etc.) the student is asked to modify remain covered as the instructions are given (to prevent visual rehearsal). After being presented with the oral instruction the students are expected to move the card covering the stimuli and then to executive the visual-spatial, directional, sequential, and logical if–then the instructions  by marking them on the response form.  The fact that the visual stimuli remains covered until the last moment increases the demands on the student’s memory and comprehension.  The subtest was created to simulate teacher’s use of procedural language (giving directions) in classroom setting (as per developers).

TILLS-subtest-9-delayed-story-retelling

9. The Delayed Story Retelling (DSR) subtest (description above) needs to be administered to the students during the same session as the Story Retelling (SR) subtest, approximately 20 minutes after the SR subtest administration.  Despite the relatively short passage of time between both subtests, it is considered to be a measure of long-term memory as related to narrative retelling of reduced complexity. Here, the examiner can compare student’s performance to determine whether the student did better or worse on either of these measures (e.g., recalled more information after a period of time passed vs. immediately after being read the story).  However, as mentioned previously, some students may recall this previously presented story fairly accurately and as a result may obtain an average score despite a history of teacher/parent reported  long-term memory limitations.  Consequently, it may be important for the examiner to supplement the administration of this subtest with a recall of a movie/book recently seen/read by the student (a few days ago) in order to compare both performances and note any weaknesses/limitations.

TILLS-subtest-10-nonword-reading

10. The Nonword Reading (NR) subtest (description above) requires students to decode nonsense words of increasing length and complexity. What I love about this subtest is that the students are unable to effectively guess words (as many tend to routinely do when presented with real words). Consequently, the presentation of this subtest will tease out which students have good letter/sound correspondence abilities as well as solid orthographic, morphological and phonological awareness skills and which ones only memorized sight words and are now having difficulty decoding unfamiliar words as a result.      TILLS-subtest-11-reading-fluency

11. The Reading Fluency (RF) subtest (description above) requires students to efficiently read facts which make up simple stories fluently and correctly.  Here are the key to attaining an average score is accuracy and automaticity.  In contrast to the previous subtest, the words are now presented in meaningful simple syntactic contexts.

It is important to note that the Reading Fluency subtest of the TILLS has a negatively skewed distribution. As per authors, “a large number of typically developing students do extremely well on this subtest and a much smaller number of students do quite poorly.”

Thus, “the mean is to the left of the mode” (see publisher’s image below). This is why a student could earn an average standard score (near the mean) and a low percentile rank when true percentiles are used rather than NCE percentiles (Normal Curve Equivalent). Tills Q&A – Negative Skew

Consequently under certain conditions (See HERE) the percentile rank (vs. the NCE percentile) will be a more accurate representation of the student’s ability on this subtest.

Indeed, due to the reduced complexity of the presented words some students (especially younger elementary aged) may obtain average scores and still present with serious reading fluency deficits.  

I frequently see that in students with average IQ and go to long-term memory, who by second and third grades have managed to memorize an admirable number of sight words due to which their deficits in the areas of reading appeared to be minimized.  Recommendation: If you suspect that your student belongs to the above category I highly recommend supplementing this subtest with an informal measure of reading fluency.  This can be done by presenting to the student a grade level text (I find science and social studies texts particularly useful for this purpose) and asking them to read several paragraphs from it (see HERE and/or HERE).

As the students are reading  I calculate their reading fluency by counting the number of words they read per minute.  I find it very useful as it allows me to better understand their reading profile (e.g, fast/inaccurate reader, slow/inaccurate reader, slow accurate reader, fast/accurate reader).   As the student is reading I note their pauses, misreadings, word-attack skills and the like. Then, I write a summary comparing the students reading fluency on both standardized and informal assessment measures in order to document students strengths and limitations.

TILLS-subtest-12-written-expression

12. The Written Expression (WE) subtest (description above) needs to be administered to the students immediately after the administration of the Reading Fluency (RF) subtest because the student is expected to integrate a series of facts presented in the RF subtest into their writing sample. There are 4 stories in total for the 4 different age groups.

The examiner needs to show the student a different story which integrates simple facts into a coherent narrative. After the examiner reads that simple story to the students s/he is expected to tell the students that the story is  okay, but “sounds kind of “choppy.” They then need to show the student an example of how they could put the facts together in a way that sounds more interesting and less choppy  by combining sentences (see below). Finally, the examiner will ask the students to rewrite the story presented to them in a similar manner (e.g, “less choppy and more interesting.”)

tills

After the student finishes his/her story, the examiner will analyze it and generate the following scores: a discourse score, a sentence score, and a word score. Detailed instructions as well as the Examiner’s Practice Workbook are provided to assist with scoring as it takes a bit of training as well as trial and error to complete it, especially if the examiners are not familiar with certain procedures (e.g., calculating T-units).

Full disclosure: Because the above subtest is still essentially sentence combining, I have only used this subtest a handful of times with my students. Typically when I’ve used it in the past, most of my students fell in two categories: those who failed it completely by either copying text word  for word, failing to generate any written output etc. or those who passed it with flying colors but still presented with notable written output deficits. Consequently, I’ve replaced Written Expression subtest administration with the administration of written standardized tests, which I supplement with an informal grade level expository, persuasive, or narrative writing samples.

Having said that many clinicians may not have the access to other standardized written assessments, or lack the time to administer entire standardized written measures (which may frequently take between 60 to 90 minutes of administration time). Consequently, in the absence of other standardized writing assessments, this subtest can be effectively used to gauge the student’s basic writing abilities, and if needed effectively supplemented by informal writing measures (mentioned above).

TILLS-subtest-13-social-communication

13. The Social Communication (SC) subtest (description above) assesses the students’ ability to understand vocabulary associated with communicative intentions in social situations. It requires students to comprehend how people with certain characteristics might respond in social situations by formulating responses which fit the social contexts of those situations. Essentially students become actors who need to act out particular scenes while viewing select words presented to them.

Full disclosure: Similar to my infrequent administration of the Written Expression subtest, I have also administered this subtest very infrequently to students.  Here is why.

I am an SLP who works full-time in a psychiatric hospital with children diagnosed with significant psychiatric impairments and concomitant language and literacy deficits.  As a result, a significant portion of my job involves comprehensive social communication assessments to catalog my students’ significant deficits in this area. Yet, past administration of this subtest showed me that number of my students can pass this subtest quite easily despite presenting with notable and easily evidenced social communication deficits. Consequently, I prefer the administration of comprehensive social communication testing when working with children in my hospital based program or in my private practice, where I perform independent comprehensive evaluations of language and literacy (IEEs).

Again, as I’ve previously mentioned many clinicians may not have the access to other standardized social communication assessments, or lack the time to administer entire standardized written measures. Consequently, in the absence of other social communication assessments, this subtest can be used to get a baseline of the student’s basic social communication abilities, and then be supplemented with informal social communication measures such as the Informal Social Thinking Dynamic Assessment Protocol (ISTDAP) or observational social pragmatic checklists

TILLS-subtest-14-digit-span-forward

14.  The Digit Span Forward (DSF) subtest (description above) is a relatively isolated  measure  of short term and verbal working memory ( it minimizes demands on other aspects of language such as syntax or vocabulary).

TILLS-subtest-15-digit-span-backward

15.  The Digit Span Backward (DSB) subtest (description above) assesses the student’s working memory and requires the student to mentally manipulate the presented stimuli in reverse order. It allows examiner to observe the strategies (e.g. verbal rehearsal, visual imagery, etc.) the students are using to aid themselves in the process.  Please note that the Digit Span Forward subtest must be administered immediately before the administration of this subtest.

SLPs who have used tests such as the Clinical Evaluation of Language Fundamentals – 5 (CELF-5) or the Test of Auditory Processing Skills – Third Edition (TAPS-3) should be highly familiar with both subtests as they are fairly standard measures of certain aspects of memory across the board.

To continue, in addition to the presence of subtests which assess the students literacy abilities, the TILLS also possesses a number of interesting features.

For starters, the TILLS Easy Score, which allows the examiners to use their scoring online. It is incredibly easy and effective. After clicking on the link and filling out the preliminary demographic information, all the examiner needs to do is to plug in this subtest raw scores, the system does the rest. After the raw scores are plugged in, the system will generate a PDF document with all the data which includes (but is not limited to) standard scores, percentile ranks, as well as a variety of composite and core scores. The examiner can then save the PDF on their device (laptop, PC, tablet etc.) for further analysis.

The there is the quadrant model. According to the TILLS sampler (HERE)  “it allows the examiners to assess and compare students’ language-literacy skills at the sound/word level and the sentence/ discourse level across the four oral and written modalities—listening, speaking, reading, and writing” and then create “meaningful profiles of oral and written language skills that will help you understand the strengths and needs of individual students and communicate about them in a meaningful way with teachers, parents, and students. (pg. 21)”

tills quadrant model

Then there is the Student Language Scale (SLS) which is a one page checklist parents,  teachers (and even students) can fill out to informally identify language and literacy based strengths and weaknesses. It  allows for meaningful input from multiple sources regarding the students performance (as per IDEA 2004) and can be used not just with TILLS but with other tests or in even isolation (as per developers).

Furthermore according to the developers, because the normative sample included several special needs populations, the TILLS can be used with students diagnosed with ASD,  deaf or hard of hearing (see caveat), as well as intellectual disabilities (as long as they are functioning age 6 and above developmentally).

According to the developers the TILLS is aligned with Common Core Standards and can be administered as frequently as two times a year for progress monitoring (min of 6 mos post 1st administration).

With respect to bilingualism examiners can use it with caution with simultaneous English learners but not with sequential English learners (see further explanations HERE).   Translations of TILLS are definitely not allowed as they will undermine test validity and reliability.

So there you have it these are just some of my very few impressions regarding this test.  Now to some of you may notice that I spend a significant amount of time pointing out some of the tests limitations. However, it is very important to note that we have research that indicates that there is no such thing as a “perfect standardized test” (see HERE for more information).   All standardized tests have their limitations

Having said that, I think that TILLS is a PHENOMENAL addition to the standardized testing market, as it TRULY appears to assess not just language but also literacy abilities of the students on our caseloads.

That’s all from me; however, before signing off I’d like to provide you with more resources and information, which can be reviewed in reference to TILLS.  For starters, take a look at Brookes Publishing TILLS resources.  These include (but are not limited to) TILLS FAQ, TILLS Easy-Score, TILLS Correction Document, as well as 3 FREE TILLS Webinars.   There’s also a Facebook Page dedicated exclusively to TILLS updates (HERE).

But that’s not all. Dr. Nelson and her colleagues have been tirelessly lecturing about the TILLS for a number of years, and many of their past lectures and presentations are available on the ASHA website as well as on the web (e.g., HERE, HERE, HERE, etc). Take a look at them as they contain far more in-depth information regarding the development and implementation of this groundbreaking assessment.

Disclaimer:  I did not receive a complimentary copy of this assessment for review nor have I received any encouragement or compensation from either Brookes Publishing  or any of the TILLS developers to write it.  All images of this test are direct property of Brookes Publishing (when clicked on all the images direct the user to the Brookes Publishing website) and were used in this post for illustrative purposes only.

References: 

Leclercq A, Maillart C, Majerus S. (2013) Nonword repetition problems in children with SLI: A deficit in accessing long-term linguistic representations? Topics in Language Disorders. 33 (3) 238-254.

Related Posts: