Posted on

Components of Qualitative Writing Assessments: What Exactly are We Trying to Measure?

Writing! The one assessment area that challenges many SLPs on daily basis! If one polls 10 SLPs on the topic of writing, one will get 10 completely different responses ranging from agreement and rejection to the diverse opinions regarding what should actually be assessed and how exactly it should be accomplished.

Consequently, today I wanted to focus on the basics involved in the assessment of adolescent writing. Why adolescents you may ask? Well, frankly because many SLPs (myself included) are far more likely to assess the writing abilities of adolescents rather than elementary-aged children.

Often, when the students are younger and their literacy abilities are weaker, the SLPs may not get to the assessment of writing abilities due to the students presenting with so many other deficits which require precedence intervention-wise. However, as the students get older and the academic requirements increase exponentially, SLPs may be more frequently asked to assess the students’ writing abilities because difficulties in this area significantly affect them in a variety of classes on a variety of subjects.

So what can we assess when it comes to writing? In the words of Helen Lester’s character ‘Pookins’: “Lots!”  There are various types of writing that can be assessed, the most common of which include: expository, persuasive, and fictional. Each of these can be used for assessment purposes in a variety of ways.

To illustrate, if we chose to analyze the student’s written production of fictional narratives then we may broadly choose to analyze the following aspects of the student’s writing: contextual conventions and writing composition.

The former looks at such writing aspects as the use of correct spelling, punctuation, and capitalization, paragraph formation, etc.

The latter looks at the nitty-gritty elements involved in plot development. These include effective use of literate vocabulary, plotline twists, character development,  use of dialogue, etc.

Perhaps we want to analyze the student’s persuasive writing abilities. After all, high school students are expected to utilize this type of writing frequently for essay writing purposes.  Actually, persuasive writing is a complex genre which is particularly difficult for students with language-learning difficulties who struggle to produce essays that are clear, logical, convincing, appropriately sequenced, and take into consideration opposing points of view. It is exactly for that reason that persuasive writing tasks are perfect for assessment purposes.

But what exactly are we looking for analysis wise? What should a typical 15 year old’s persuasive essays contain?

With respect to syntax, a typical student that age is expected to write complex sentences possessing nominal, adverbial, as well as relative clauses.

With the respect to semantics, effective persuasive essays require the use of literate vocabulary words of low frequency such as later developing connectors (e.g., first of all, next, for this reason, on the other hand, consequently, finally, in conclusion) as well as metalinguistic and metacognitive verbs (“metaverbs”) that refer to acts of speaking (e.g., assert, concede, predict, argue, imply) and thinking (e.g., hypothesize, remember, doubt, assume, infer).

With respect to pragmatics, as students  mature, their sensitivity to the perspectives of others improves, as a result, their persuasive essays increase in length (i.e., total number of words produced) and they are able to offer a greater number of different reasons to support their own opinions (Nippold, Ward-Lonergan, & Fanning, 2005).

Now let’s apply our knowledge by analyzing a writing sample of a 15-year-old with suspected literacy deficits. Below 10th-grade student was provided with a written prompt first described in the Nippold, et al, 2005 study, entitled: “The Circus Controversy”.   “People have different views on animals performing in circuses. For example, some people think it is a great idea because it provides lots of entertainment for the public. Also, it gives parents and children something to do together, and the people who train the animals can make some money. However, other people think having animals in circuses is a bad idea because the animals are often locked in small cages and are not fed well. They also believe it is cruel to force a dog, tiger, or elephant to perform certain tricks that might be dangerous. I am interested in learning what you think about this controversy, and whether or not you think circuses with trained animals should be allowed to perform for the public. I would like you to spend the next 20 minutes writing an essay. Tell me exactly what you think about the controversy. Give me lots of good reasons for your opinion. Please use your best writing style, with correct grammar and spelling. If you aren’t sure how to spell a word, just take a guess.”(Nippold, Ward-Lonergan, & Fanning, 2005)

He produced the following written sample during the allotted 20 minutes.

Analysis: This student was able to generate a short, 3-paragraph, composition containing an introduction and a body without a definitive conclusion. His persuasive essay was judged to be very immature for his grade level due to significant disorganization, limited ability to support his point of view as well as the presence of tangential information in the introduction of his composition, which was significantly compromised by many writing mechanics errors (punctuation, capitalization, as well as spelling) that further impacted the coherence and cohesiveness of his written output.

The student’s introduction began with an inventive dialogue, which was irrelevant to the body of his persuasive essay. He did have three important points relevant to the body of the essay: animal cruelty, danger to the animals, and potential for the animals to harm humans. However, he was unable to adequately develop those points into full paragraphs. The notable absence of proofreading and editing of the composition further contributed to its lack of clarity. The above coupled with a lack of a conclusion was not commensurate grade-level expectations.

Based on the above-written sample, the student’s persuasive composition content (thought formulation and elaboration) was judged to be significantly immature for his grade level and is commensurate with the abilities of a much younger student.  The student’s composition contained several emerging claims that suggested a vague position. However, though the student attempted to back up his opinion and support his position (animals should not be performing in circuses), ultimately he was unable to do so in a coherent and cohesive manner.

Now that we know what the student’s written difficulties look like, the following goals will be applicable with respect to his writing remediation:

Long-Term Goals:  Student will improve his written abilities for academic purposes.

  • Short-Term Goals
  1. Student will appropriately utilize parts of speech (e.g., adjectives, adverbs, prepositions, etc.)  in compound and complex sentences.
  2. Student will use a variety of sentence types for story composition purposes (e.g., declarative, interrogative, imperative, and exclamatory sentences).
  3. Student will correctly use past, present, and future verb tenses during writing tasks.
  4. Student will utilize appropriate punctuation at the sentence level (e.g., apostrophes, periods, commas, colons, quotation marks in dialogue, and apostrophes in singular possessives, etc.).
  5. Student will utilize appropriate capitalization at the sentence level (e.g., capitalize proper nouns, holidays, product names, titles with names, initials, geographic locations, historical periods, special events, etc.).
  6. Student will use prewriting techniques to generate writing ideas (e.g., list keywords, state key ideas, etc.).
  7. Student will determine the purpose of his writing and his intended audience in order to establish the tone of his writing as well as outline the main idea of his writing.
  8. Student will generate a draft in which information is organized in chronological order via use of temporal markers (e.g., “meanwhile,” “immediately”) as well as cohesive ties (e.g., ‘but’, ‘yet’, ‘so’, ‘nor’) and cause/effect transitions (e.g., “therefore,” “as a result”).
  9. Student will improve coherence and logical organization of his written output via the use of revision strategies (e.g., modify supporting details, use sentence variety, employ literary devices).
  10. Student will edit his draft for appropriate grammar, spelling, punctuation, and capitalization.

There you have it. A quick and easy qualitative writing assessment which can assist SLPs to determine the extent of the student’s writing difficulties as well as establish writing remediation targets for intervention purposes.

Using a different type of writing assessment with your students? Please share the details below so we can all benefit from each others knowledge of assessment strategies.

References:

  • Nippold, M., Ward-Lonergan, J., & Fanning, J. (2005). Persuasive writing in children, adolescents, and adults: a study of syntactic, semantic, and pragmatic development. Language, Speech, and Hearing Services in Schools, 36, 125-138.

 

Posted on

FREE Resources for Working with Russian Speaking Clients: Part III Introduction to “Dyslexia”

Image result for дислексияGiven the rising interest in recent years in the role of SLPs in the treatment of reading disorders, today I wanted to share with parents and professionals several reputable  FREE resources on the subject of “dyslexia” in Russian-speaking children.

Now if you already knew that there was a dearth of resources on the topic of treating Russian speaking children with language disorders then it will not come as a complete shock to you that very few legitimate sources exist on this subject.

Related imageFirst up is the Report on the Russian Language for the World Dyslexia Forum 2010 by Dr. Grigorenko, the coauthor of the Dyslexia Debate. This 25-page report contains important information including Reading/Writing Acquisition of Russian in the Context of Typical and Atypical Development as well as on the state of Individuals with Dyslexia in Russia.

Related imageNext up is this delightful presentation entitled: “If John were Ivan: Would he fail in reading? Dyslexia & dysgraphia in Russian“. It is a veritable treasure trove of useful information on the topics of:

  • The Russian language
  • Literacy in Russia (Russian Federation)
  • Dyslexia in Russia
    • Definition
    • Identification
    • Policy
  • Examples of good practice
    • Teaching reading/language arts
      • In regular schools
      • In specialized settings
    • Encouraging children to learn

Image result for orthographyNow let us move on to the “The Role of Phonology, Morphology, and Orthography in English and Russian Spelling” which discusses that “phonology and morphology contribute more for spelling of English words while orthography and morphology contribute more to the spelling of Russian words“. It also provides clinicians with access to the stimuli from the orthographic awareness and spelling tests in both English and Russian, listed in its appendices.

Finally, for parents and Russian speaking professionals, there’s an excellent article entitled, “Дислексия” in which Dr. Grigorenko comprehensively discusses the state of the field in Russian including information on its causes, rehabilitation, etc.

Related Helpful Resources:

  1. Анализ Нарративов У Детей С Недоразвитием Речи (Narrative Discourse Analysis in Children With Speech Underdevelopment)
  2. Narrative production weakness in Russian dyslexics: Linguistic or procedural limitations?

 

Posted on

It’s All Due to …Language: How Subtle Symptoms Can Cause Serious Academic Deficits

Scenario: Len is a 7-2-year-old, 2nd-grade student who struggles with reading and writing in the classroom. He is very bright and has a high average IQ, yet when he is speaking he frequently can’t get his point across to others due to excessive linguistic reformulations and word-finding difficulties. The problem is that Len passed all the typical educational and language testing with flying colors, receiving average scores across the board on various tests including the Woodcock-Johnson Fourth Edition (WJ-IV) and the Clinical Evaluation of Language Fundamentals-5 (CELF-5). Stranger still is the fact that he aced Comprehensive Test of Phonological Processing, Second Edition (CTOPP-2), with flying colors, so he is not even eligible for a “dyslexia” diagnosis. Len is clearly struggling in the classroom with coherently expressing self, telling stories, understanding what he is reading, as well as putting his thoughts on paper. His parents have compiled impressively huge folders containing examples of his struggles. Yet because of his performance on the basic standardized assessment batteries, Len does not qualify for any functional assistance in the school setting, despite being virtually functionally illiterate in second grade.

The truth is that Len is quite a familiar figure to many SLPs, who at one time or another have encountered such a student and asked for guidance regarding the appropriate accommodations and services for him on various SLP-geared social media forums. But what makes Len such an enigma, one may inquire? Surely if the child had tangible deficits, wouldn’t standardized testing at least partially reveal them?

Well, it all depends really, on what type of testing was administered to Len in the first place. A few years ago I wrote a post entitled: “What Research Shows About the Functional Relevance of Standardized Language Tests“.  What researchers found is that there is a “lack of a correlation between frequency of test use and test accuracy, measured both in terms of sensitivity/specificity and mean difference scores” (Betz et al, 2012, 141). Furthermore, they also found that the most frequently used tests were the comprehensive assessments including the Clinical Evaluation of Language Fundamentals and the Preschool Language Scale as well as one-word vocabulary tests such as the Peabody Picture Vocabulary Test”. Most damaging finding was the fact that: “frequently SLPs did not follow up the comprehensive standardized testing with domain-specific assessments (critical thinking, social communication, etc.) but instead used the vocabulary testing as a second measure”.(Betz et al, 2012, 140)

In other words, many SLPs only use the tests at hand rather than the RIGHT tests aimed at identifying the student’s specific deficits. But the problem doesn’t actually stop there. Due to the variation in psychometric properties of various tests, many children with language impairment are overlooked by standardized tests by receiving scores within the average range or not receiving low enough scores to qualify for services.

Thus, “the clinical consequence is that a child who truly has a language impairment has a roughly equal chance of being correctly or incorrectly identified, depending on the test that he or she is given.” Furthermore, “even if a child is diagnosed accurately as language impaired at one point in time, future diagnoses may lead to the false perception that the child has recovered, depending on the test(s) that he or she has been given (Spaulding, Plante & Farinella, 2006, 69).”

There’s of course yet another factor affecting our hypothetical client and that is his relatively young age. This is especially evident with many educational and language testing for children in the 5-7 age group. Because the bar is set so low, concept-wise for these age-groups, many children with moderate language and literacy deficits can pass these tests with flying colors, only to be flagged by them literally two years later and be identified with deficits, far too late in the game.  Coupled with the fact that many SLPs do not utilize non-standardized measures to supplement their assessments, Len is in a pretty serious predicament.

But what if there was a do-over? What could we do differently for Len to rectify this situation? For starters, we need to pay careful attention to his deficits profile in order to choose appropriate tests to evaluate his areas of needs. The above can be accomplished via a number of ways. The SLP can interview Len’s teacher and his caregiver/s in order to obtain a summary of his pressing deficits. Depending on the extent of the reported deficits the SLP can also provide them with a referral checklist to mark off the most significant areas of need.

In Len’s case, we already have a pretty good idea regarding what’s going on. We know that he passed basic language and educational testing, so in the words of Dr. Geraldine Wallach, we need to keep “peeling the onion” via the administration of more sensitive tests to tap into Len’s reported areas of deficits which include: word-retrieval, narrative production, as well as reading and writing.

For that purpose, Len is a good candidate for the administration of the Test of Integrated Language and Literacy (TILLS), which was developed to identify language and literacy disorders, has good psychometric properties, and contains subtests for assessment of relevant skills such as reading fluency, reading comprehension, phonological awareness,  spelling, as well as writing  in school-age children.

Given Len’s reported history of narrative production deficits, Len is also a good candidate for the administration of the Social Language Development Test Elementary (SLDTE). Here’s why. Research indicates that narrative weaknesses significantly correlate with social communication deficits (Norbury, Gemmell & Paul, 2014). As such, it’s not just children with Autism Spectrum Disorders who present with impaired narrative abilities. Many children with developmental language impairment (DLD) (#devlangdis) can present with significant narrative deficits affecting their social and academic functioning, which means that their social communication abilities need to be tested to confirm/rule out presence of these difficulties.

However, standardized tests are not enough, since even the best-standardized tests have significant limitations. As such, several non-standardized assessments in the areas of narrative production, reading, and writing, may be recommended for Len to meaningfully supplement his testing.

Let’s begin with an informal narrative assessment which provides detailed information regarding microstructural and macrostructural aspects of storytelling as well as child’s thought processes and socio-emotional functioning. My nonstandardized narrative assessments are based on the book elicitation recommendations from the SALT website. For 2nd graders, I use the book by Helen Lester entitled Pookins Gets Her Way. I first read the story to the child, then cover up the words and ask the child to retell the story based on pictures. I read the story first because: “the model narrative presents the events, plot structure, and words that the narrator is to retell, which allows more reliable scoring than a generated story that can go in many directions” (Allen et al, 2012, p. 207).

As the child is retelling his story I digitally record him using the Voice Memos application on my iPhone, for a later transcription and thorough analysis.  During storytelling, I only use the prompts: ‘What else can you tell me?’ and ‘Can you tell me more?’ to elicit additional information. I try not to prompt the child excessively since I am interested in cataloging all of his narrative-based deficits. After I transcribe the sample, I analyze it and make sure that I include the transcription and a detailed write-up in the body of my report, so parents and professionals can see and understand the nature of the child’s errors/weaknesses.

Now we are ready to move on to a brief nonstandardized reading assessment. For this purpose, I often use the books from the Continental Press series entitled: Reading for Comprehension, which contains books for grades 1-8.  After I confirm with either the parent or the child’s teacher that the selected passage is reflective of the complexity of work presented in the classroom for his grade level, I ask the child to read the text.  As the child is reading, I calculate the correct number of words he reads per minute as well as what type of errors the child is exhibiting during reading.  Then I ask the child to state the main idea of the text, summarize its key points as well as define select text embedded vocabulary words and answer a few, verbally presented reading comprehension questions. After that, I provide the child with accompanying 5 multiple choice question worksheet and ask the child to complete it. I analyze my results in order to determine whether I have accurately captured the child’s reading profile.

Finally, if any additional information is needed, I administer a nonstandardized writing assessment, which I base on the Common Core State Standards for 2nd grade. For this task, I provide a student with a writing prompt common for second grade and give him a period of 15-20 minutes to generate a writing sample. I then analyze the writing sample with respect to contextual conventions (punctuation, capitalization, grammar, and syntax) as well as story composition (overall coherence and cohesion of the written sample).

The above relatively short assessment battery (2 standardized tests and 3 informal assessment tasks) which takes approximately 2-2.5 hours to administer, allows me to create a comprehensive profile of the child’s language and literacy strengths and needs. It also allows me to generate targeted goals in order to begin effective and meaningful remediation of the child’s deficits.

Children like Len will, unfortunately, remain unidentified unless they are administered more sensitive tasks to better understand their subtle pattern of deficits. Consequently, to ensure that they do not fall through the cracks of our educational system due to misguided overreliance on a limited number of standardized assessments, it is very important that professionals select the right assessments, rather than the assessments at hand, in order to accurately determine the child’s areas of needs.

References:

Posted on

Making Our Interventions Count or What’s Research Got To Do With It?

Two years ago I wrote a blog post entitled: “What’s Memes Got To Do With It?” which summarized key points of Dr. Alan G. Kamhi’s 2004 article: “A Meme’s Eye View of Speech-Language Pathology“. It delved into answering the following question: “Why do some terms, labels, ideas, and constructs [in our field] prevail whereas others fail to gain acceptance?”.

Today I would like to reference another article by Dr. Kamhi written in 2014, entitled “Improving Clinical Practices for Children With Language and Learning Disorders“.

This article was written to address the gaps between research and clinical practice with respect to the implementation of EBP for intervention purposes.

Dr. Kamhi begins the article by posing 10 True or False questions for his readers:

  1. Learning is easier than generalization.
  2. Instruction that is constant and predictable is more effective than instruction that varies the conditions of learning and practice.
  3. Focused stimulation (massed practice) is a more effective teaching strategy than varied stimulation (distributed practice).
  4. The more feedback, the better.
  5. Repeated reading of passages is the best way to learn text information.
  6. More therapy is always better.
  7. The most effective language and literacy interventions target processing limitations rather than knowledge deficits.
  8. Telegraphic utterances (e.g., push ball, mommy sock) should not be provided as input for children with limited language.
  9. Appropriate language goals include increasing levels of mean length of utterance (MLU) and targeting Brown’s (1973) 14 grammatical morphemes.
  10. Sequencing is an important skill for narrative competence.

Guess what? Only statement 8 of the above quiz is True! Every other statement from the above is FALSE!

Now, let’s talk about why that is!

First up is the concept of learning vs. generalization. Here Dr. Kamhi discusses that some clinicians still possess an “outdated behavioral view of learning” in our field, which is not theoretically and clinically useful. He explains that when we are talking about generalization – what children truly have a difficulty with is “transferring narrow limited rules to new situations“. “Children with language and learning problems will have difficulty acquiring broad-based rules and modifying these rules once acquired, and they also will be more vulnerable to performance demands on speech production and comprehension (Kamhi, 1988)” (93). After all, it is not “reasonable to expect children to use language targets consistently after a brief period of intervention” and while we hope that “language intervention [is] designed to lead children with language disorders to acquire broad-based language rules” it is a hugely difficult task to undertake and execute.

Next, Dr. Kamhi addresses the issue of instructional factors, specifically the importance of “varying conditions of instruction and practice“.  Here, he addresses the fact that while contextualized instruction is highly beneficial to learners unless we inject variability and modify various aspects of instruction including context, composition, duration, etc., we ran the risk of limiting our students’ long-term outcomes.

After that, Dr. Kamhi addresses the concept of distributed practice (spacing of intervention) and how important it is for teaching children with language disorders. He points out that a number of recent studies have found that “spacing and distribution of teaching episodes have more of an impact on treatment outcomes than treatment intensity” (94).

He also advocates reducing evaluative feedback to learners to “enhance long-term retention and generalization of motor skills“. While he cites research from studies pertaining to speech production, he adds that language learning could also benefit from this practice as it would reduce conversational disruptions and tunning out on the part of the student.

From there he addresses the limitations of repetition for specific tasks (e.g., text rereading). He emphasizes how important it is for students to recall and retrieve text rather than repeatedly reread it (even without correction), as the latter results in a lack of comprehension/retention of read information.

After that, he discusses treatment intensity. Here he emphasizes the fact that higher dose of instruction will not necessarily result in better therapy outcomes due to the research on the effects of “learning plateaus and threshold effects in language and literacy” (95). We have seen research on this with respect to joint book reading, vocabulary words exposure, etc. As such, at a certain point in time increased intensity may actually result in decreased treatment benefits.

His next point against processing interventions is very near and dear to my heart. Those of you familiar with my blog know that I have devoted a substantial number of posts pertaining to the lack of validity of CAPD diagnosis (as a standalone entity) and urged clinicians to provide language based vs. specific auditory interventions which lack treatment utility. Here, Dr. Kamhi makes a great point that: “Interventions that target processing skills are particularly appealing because they offer the promise of improving language and learning deficits without having to directly target the specific knowledge and skills required to be a proficient speaker, listener, reader, and writer.” (95) The problem is that we have numerous studies on the topic of improvement of isolated skills (e.g., auditory skills, working memory, slow processing, etc.) which clearly indicate lack of effectiveness of these interventions.  As such, “practitioners should be highly skeptical of interventions that promise quick fixes for language and learning disabilities” (96).

Now let us move on to language and particularly the models we provide to our clients to encourage greater verbal output. Research indicates that when clinicians are attempting to expand children’s utterances, they need to provide well-formed language models. Studies show that children select strong input when its surrounded by weaker input (the surrounding weaker syllables make stronger syllables stand out).  As such, clinicians should expand upon/comment on what clients are saying with grammatically complete models vs. telegraphic productions.

From there lets us take a look at Dr. Kamhi’s recommendations for grammar and syntax. Grammatical development goes much further than addressing Brown’s morphemes in therapy and calling it a day. As such, it is important to understand that children with developmental language disorders (DLD) (#DevLang) do not have difficulty acquiring all morphemes. Rather studies have shown that they have difficulty learning grammatical morphemes that reflect tense and agreement  (e.g., third-person singular, past tense, auxiliaries, copulas, etc.). As such, use of measures developed by (e.g., Tense Marker Total & Productivity Score) can yield helpful information regarding which grammatical structures to target in therapy.

With respect to syntax, Dr. Kamhi notes that many clinicians erroneously believe that complex syntax should be targeted when children are much older. The Common Core State Standards do not help this cause further, since according to the CCSS complex syntax should be targeted 2-3 grades, which is far too late. Typically developing children begin developing complex syntax around 2 years of age and begin readily producing it around 3 years of age. As such, clinicians should begin targeting complex syntax in preschool years and not wait until the children have mastered all morphemes and clauses (97)

Finally, Dr. Kamhi wraps up his article by offering suggestions regarding prioritizing intervention goals. Here, he explains that goal prioritization is affected by

  • clinician experience and competencies
  • the degree of collaboration with other professionals
  • type of service delivery model
  • client/student factors

He provides a hypothetical case scenario in which the teaching responsibilities are divvied up between three professionals, with SLP in charge of targeting narrative discourse. Here, he explains that targeting narratives does not involve targeting sequencing abilities. “The ability to understand and recall events in a story or script depends on conceptual understanding of the topic and attentional/memory abilities, not sequencing ability.”  He emphasizes that sequencing is not a distinct cognitive process that requires isolated treatment. Yet many SLPs “continue to believe that  sequencing is a distinct processing skill that needs to be assessed and treated.” (99)

Dr. Kamhi supports the above point by providing an example of two passages. One, which describes a random order of events, and another which follows a logical order of events. He then points out that the randomly ordered story relies exclusively on attention and memory in terms of “sequencing”, while the second story reduces demands on memory due to its logical flow of events. As such, he points out that retelling deficits seemingly related to sequencing, tend to be actually due to “limitations in attention, working memory, and/or conceptual knowledge“. Hence, instead of targeting sequencing abilities in therapy, SLPs should instead use contextualized language intervention to target aspects of narrative development (macro and microstructural elements).

Furthermore, here it is also important to note that the “sequencing fallacy” affects more than just narratives. It is very prevalent in the intervention process in the form of the ubiquitous “following directions” goal/s. Many clinicians readily create this goal for their clients due to their belief that it will result in functional therapeutic language gains. However, when one really begins to deconstruct this goal, one will realize that it involves a number of discrete abilities including: memory, attention, concept knowledge, inferencing, etc.  Consequently, targeting the above goal will not result in any functional gains for the students (their memory abilities will not magically improve as a result of it). Instead, targeting specific language and conceptual goals  (e.g., answering questions, producing complex sentences, etc.) and increasing the students’ overall listening comprehension and verbal expression will result in improvements in the areas of attention, memory, and processing, including their ability to follow complex directions.

There you have it! Ten practical suggestions from Dr. Kamhi ready for immediate implementation! And for more information, I highly recommend reading the other articles in the same clinical forum, all of which possess highly practical and relevant ideas for therapeutic implementation. They include:

References:

Kamhi, A. (2014). Improving clinical practices for children with language and learning disorders.  Language, Speech, and Hearing Services in Schools, 45(2), 92-103

Helpful Social Media Resources:

SLPs for Evidence-Based Practice

Posted on

What Should be Driving Our Treatment?

Today  I want to talk treatment.  That thing that we need to plan for as we are doing our assessments.   But are we starting our treatments the right way? The answer may surprise you. I often see SLPs phrasing questions regarding treatment the following way: “I have a student diagnosed with ____ (insert disorder here). What is everyone using (program/app/materials) during therapy sessions to address ___ diagnosis?”

Of course, the answer is never that simple. Just because a child has a diagnosis of a social communication disorder, word-finding deficits, or a reading disability does not automatically indicate to the treating clinician, which ‘cookie cutter’ materials and programs are best suited for the child in question. Only a profile of strengths and needs based on a comprehensive language and literacy testing can address this in an adequate and targeted manner.

To illustrate,  reading intervention is a much debated and controversial topic nowadays. Everywhere you turn there’s a barrage of advice for clinicians and parents regarding which program/approach to use. Barton, Wilson, OG… the well-intentioned advice just keeps on coming. The problem is that without knowing the child’s specific deficit areas, the application of the above approaches is quite frankly … pointless.

There could be endless variations of how deficits manifest in poor readers. Is it aspects of phonological awareness, phonics, morphology, etc. What combination of deficits is preventing the child from becoming a good reader?

Let’s a take a look at an example, below. It’s the CTOPP-2 results of a 7-6-year-old female with a documented history of extensive reading difficulties and a significant family history of reading disabilities in the family.

Results of the Comprehensive Test of Phonological Processing-2 (CTOPP-2)

Subtests Scaled Scores Percentile Ranks Description
Elision (EL) 7 16 Below Average
Blending Words (BW) 13 84 Above Average
Phoneme Isolation (PI) 6 9 Below Average
Memory for Digits (MD) 8 25 Average
Nonword Repetition (NR) 8 25 Average
Rapid Digit Naming (RD) 10 50 Average
Rapid Letter Naming (RL) 11 63 Average
Blending Nonwords (BN) 8 25 Average
Segmenting Nonwords (SN) 8 25 Average

However, the results of her CTOPP-2 testing clearly indicate that phonological awareness, despite two areas of mild weaknesses, is not really a significant problem for this child.  So let’s look at the student’s reading fluency results.

Reading Fluency: “LG’s reading fluency during this task was judged to be significantly affected by excessive speed, inappropriate pausing, word misreadings, choppy prosody, as well as inefficient word attack skills.  While she was able to limitedly utilize the phonetic spelling of unfamiliar words (e.g., __) provided to her in parenthesis next to the word (which she initially misread as ‘__’), she exhibited limited use of metalinguistic strategies (e.g., pre-scanning sentences to aid text comprehension, self-correcting to ensure that the read words made sense in the context of the sentence, etc.), when reading the provided passage. To illustrate, during the reading of the text, LG was observed to frequently (at least 3 times) lose her place and skip entire lines of text without any attempts at self-correction. At times she was observed to read the same word a number of different ways (e.g., read ‘soup’ as ‘soup’ then as ‘soap’,  ‘roots’ as ‘roofs’ then as ‘roots’, etc.) without attempting to self-correct. LG’s oral reading rate was also observed to be impaired for her age/grade levels. Her prosody was significantly adversely affected due to lack of adequate pausing for punctuation marks (e.g., periods, commas, etc.).  Instead, she paused during text reading only when he could not decode select words in the text.  Though, LG was able to read 70 words per minute, which was judged to be grossly commensurate with grade-level, out of these 70 words she skipped 2 entire lines of text, invented an entire line of text, as well as made 4 decoding errors and 6 inappropriate pauses.”

So now we know that despite quite decent phonological awareness abilities, this student presents with quite poor sound-letter correspondence skills and will definitely benefit from explicit phonics instruction addressing the above deficit areas. But that is only the beginning!   By looking at the analysis of specific misreadings we next need to determine what other literacy areas need to be addressed. For the sake of brevity, I can specify that further analysis of this child reading abilities revealed that reading comprehension, orthographic knowledge, as well as morphological awareness were definitely areas that also required targeted remediation. The assessment also revealed that the child presented with poor spelling and writing abilities, which also needed to be addressed in the context of therapy.

Now, what if I also told you that this child had already been receiving private, Orton-Gillingham reading instruction for a period of  2 years, 1x per week, at the time the above assessment took place? Would you change your mind about the program in question? 

Well, the answer is again not so simple! OG is a fine program, but as you can see from the above example it has definite limitations and is not an exclusive fit for this child, or for any child for that matter. Furthermore, a solidly-trained in literacy clinician DOES NOT need to rely on just one program to address literacy deficits. They simply need solid knowledge of typical and atypical language and literacy development/milestones and know how to create a targeted treatment hierarchy in order to deliver effective intervention services. But for that, they need to first, thoughtfully, construct assessment-based treatment goals by carefully taking into the consideration the child’s strengths and needs.

So let’s stop asking which approach/program we should use and start asking about the child’s profile of strengths and needs in order to create accurate language and literacy goals based on solid evidence and scientifically-guided treatment practices.

Helpful Resources Pertaining to Reading:

 

Posted on

New Products for the 2017 Academic School Year for SLPs

Image result for back to schoolSeptember is quickly approaching and  school-based speech language pathologists (SLPs) are preparing to go back to work. Many of them are looking to update their arsenal of speech and language materials for the upcoming academic school year.

With that in mind, I wanted to update my readers regarding all the new products I have recently created with a focus on assessment and treatment in speech language pathology.

My most recent product Assessment of Adolescents with Language and Literacy Impairments in Speech Language Pathology  is a 130-slide pdf download which discusses how to effectively select assessment materials in order to conduct comprehensive evaluations of adolescents with suspected language and literacy disorders. It contains embedded links to ALL the books and research articles used in the development of this product.

Effective Reading Instruction Strategies for Intellectually Impaired Students is a 50-slide downloadable presentation in pdf format which describes how speech-language pathologists (SLPs) trained in assessment and intervention of literacy disorders (reading, spelling, and writing) can teach phonological awareness, phonics, as well as reading fluency skills to children with mild-moderate intellectual disabilities. It reviews the research on reading interventions conducted with children with intellectual disabilities, lists components of effective reading instruction as well as explains how to incorporate components of reading instruction into language therapy sessions.

Dysgraphia Checklist for School-Aged Children helps to identify the students’ specific written language deficits who may require further assessment and treatment services to improve their written abilities.

Processing Disorders: Controversial Aspects of Diagnosis and Treatment is a 28-slide downloadable pdf presentation which provides an introduction to processing disorders.  It describes the diversity of ‘APD’ symptoms as well as explains the current controversies pertaining to the validity of the ‘APD’ diagnosis.  It also discusses how the label “processing difficulties” often masks true language and learning deficits in students which require appropriate language and literacy assessment and targeted intervention services.

Checklist for Identification of Speech Language Disorders in Bilingual and Multicultural Children was created to assist Speech Language Pathologists (SLPs) and Teachers in the decision-making process of how to appropriately identify bilingual and multicultural children who present with speech-language delay/deficits (vs. a language difference), for the purpose of initiating a formal speech-language-literacy evaluation.  The goal is to ensure that educational professionals are appropriately identifying bilingual children for assessment and service provision due to legitimate speech language deficits/concerns, and are not over-identifying students because they speak multiple languages or because they come from low socioeconomic backgrounds.

Comprehensive Assessment and Treatment of Literacy Disorders in Speech-Language Pathology is a 125 slide presentation which describes how speech-language pathologists can effectively assess and treat children with literacy disorders, (reading, spelling, and writing deficits including dyslexia) from preschool through adolescence.  It explains the impact of language disorders on literacy development, lists formal and informal assessment instruments and procedures, as well as describes the importance of assessing higher order language skills for literacy purposes. It reviews components of effective reading instruction including phonological awareness, orthographic knowledge, vocabulary awareness,  morphological awareness, as well as reading fluency and comprehension. Finally, it provides recommendations on how components of effective reading instruction can be cohesively integrated into speech-language therapy sessions in order to improve literacy abilities of children with language disorders and learning disabilities.

Improving critical thinking via picture booksImproving Critical Thinking Skills via Picture Books in Children with Language Disorders is a partial 30-slide presentation which discusses effective instructional strategies for teaching language disordered children critical thinking skills via the use of picture books utilizing both the Original (1956) and Revised (2001) Bloom’s Taxonomy: Cognitive Domain which encompasses the (R) categories of remembering, understanding, applying, analyzing, evaluating and creating.

from wordless books to reading From Wordless Picture Books to Reading Instruction: Effective Strategies for SLPs Working with Intellectually Impaired Students is a full 92 slide presentation which discusses how to address the development of critical thinking skills through a variety of picture books  utilizing the framework outlined in Bloom’s Taxonomy: Cognitive Domain which encompasses the categories of knowledge, comprehension, application, analysis, synthesis, and evaluation in children with intellectual impairments. It shares a number of similarities with the above product as it also reviews components of effective reading instruction for children with language and intellectual disabilities as well as provides recommendations on how to integrate reading instruction effectively into speech-language therapy sessions.

Best Practices in Bilingual LiteracyBest Practices in Bilingual Literacy Assessments and Interventions is a 105 slide presentation which focuses on how bilingual speech-language pathologists (SLPs) can effectively assess and intervene with simultaneously bilingual and multicultural children (with stronger academic English language skills) diagnosed with linguistically-based literacy impairments. Topics include components of effective literacy assessments for simultaneously bilingual children (with stronger English abilities), best instructional literacy practices, translanguaging support strategies, critical questions relevant to the provision of effective interventions, as well as use of accommodations, modifications and compensatory strategies for improvement of bilingual students’ performance in social and academic settings.

Comprehensive Literacy Checklist For School-Aged Children was created to assist Speech Language Pathologists (SLPs) in the decision-making process of how to identify deficit areas and select assessment instruments to prioritize a literacy assessment for school aged children. The goal is to eliminate administration of unnecessary or irrelevant tests and focus on the administration of instruments directly targeting the specific areas of difficulty that the student presents with.

You can find these and other products in my online store (HERE). Wishing all of you a highly successful and rewarding school year!

Image result for happy school year

Posted on

The Importance of Narrative Assessments in Speech Language Pathology (Revised)

Image result for narrativeA few years ago I wrote a guest post on the importance of assessing narratives for another blog. Below is a revised version of that post containing the updates with respect to the assessment of narratives.

As SLPs we routinely administer a variety of testing batteries in order to assess our students’ speech-language abilities. Grammar, syntax, vocabulary, and sentence formulation get frequent and thorough attention. But how about narrative production? Does it get its fair share of attention when the clinicians are looking to determine the extent of the child’s language deficits? I was so curious about what the clinicians across the country were doing that in 2013, I created a survey and posted a link to it in several SLP-related FB groups.  I wanted to find out how many SLPs were performing narrative assessments, in which settings, and with which populations.  From those who were performing these assessments, I wanted to know what type of assessments were they using and how they were recording and documenting their findings.   Since the purpose of this survey was non-research based (I wasn’t planning on submitting a research manuscript with my findings), I only analyzed the first 100 responses (the rest were very similar in nature) which came my way, in order to get the general flavor of current trends among clinicians, when it came to narrative assessments. Here’s a brief overview of my [limited] findings. Continue reading The Importance of Narrative Assessments in Speech Language Pathology (Revised)

Posted on

Treatment of Children with “APD”: What SLPs Need to Know

Free stock photo of people, woman, cute, playingIn recent years there has been an increase in research on the subject of diagnosis and treatment of Auditory Processing Disorders (APD), formerly known as Central Auditory Processing Disorders or CAPD.

More and more studies in the fields of audiology and speech-language pathology began confirming the lack of validity of APD as a standalone (or useful) diagnosis. To illustrate, in June 2015, the American Journal of Audiology published an article by David DeBonis entitled: “It Is Time to Rethink Central Auditory Processing Disorder Protocols for School-Aged Children.” In this article, DeBonis pointed out numerous inconsistencies involved in APD testing and concluded that “routine use of APD test protocols cannot be supported” and that [APD] “intervention needs to be contextualized and functional” (DeBonis, 2015, p. 124)

Image result for time to rethink quotesFurthermore, in April 2017, an article entitled: “AAA (2010) CAPD clinical practice guidelines: need for an update” (also written by DeBonnis) concluded that the “AAA CAPD guidance document will need to be updated and re-conceptualised in order to provide meaningful guidance for clinicians” due to the fact that the “AAA document … does not reflect the current literature, fails to help clinicians understand for whom auditory processing testing and intervention would be most useful, includes contradictory suggestions which reduce clarity and appears to avoid conclusions that might cast the CAPD construct in a negative light. It also does not include input from diverse affected groups. All of these reduce the document’s credibility.” 

Image result for systematic reviewIn April 2016, de Wit and colleagues published a systematic review in the Journal of Speech, Language, and Hearing ResearchThey reviewed research studies which described the characteristics of APD in children to determine whether these characteristics merited a label of a distinct clinical disorder vs. being representative of other disorders.  After a search of 6 databases, they chose 48 studies which satisfied appropriate inclusion criteria. Unfortunately, they unearthed only one study with strong methodological quality. Even more disappointing was that the children in these studies presented with incredibly diverse symptomology. The authors concluded that “The listening difficulties of children with APD may be a consequence of cognitive, language, and attention issues rather than bottom-up auditory processing” (de Wit et al., 2016, p. 384).  In other words, none of the reviewed studies had conclusively proven that APD was a distinct clinical disorder.  Instead, these studies showed that the children diagnosed with APD exhibited language-based deficits. In other words, the diagnosis of APD did not reveal any new information regarding the child beyond the fact that s/he is in great need of a comprehensive language assessment in order to determine which language-based interventions s/he would optimally benefit from.

Now, it is important to reiterate that students diagnosed with “APD” present with legitimate symptomology (e.g., difficulty processing language, difficulty organizing narratives, difficulty decoding text, etc.). However, all the research to date indicates that these symptoms are indicative of broader language-based deficits, which require targeted language/literacy-based interventions rather than recommendations for specific prescriptive programs (e.g., CAPDOTS, Fast ForWord, etc.) or mere in-school accommodations.

Image result for dig deeper quotesUnfortunately, on numerous occasions when the students do receive the diagnosis of APDthe testing does not “dig further,” which leads to many of them not receiving appropriate comprehensive language-literacy assessments.  Furthermore, APD then becomes the “primary” diagnosis for the student, which places SLPs in situations in which they must address inappropriate therapeutic targets based on an audiologist’s recommendations.  Even worse, in many of these situations, the diagnosis of APD limits the provision of appropriate language-based services to the student.

Since the APD controversy has been going on for years with no end in sight despite the mounting evidence pointing to the lack of its validity, we know that SLPs will continue to have students on their caseloads diagnosed with APD. Thus, the aim of today’s post is to offer some constructive suggestions for SLPs who are asked to assess and treat students with “confirmed” or suspected APD.

The first suggestion comes directly from Dr. Alan Kamhi, who states: “Do not assume that a child who has been diagnosed with APD needs to be treated any differently than children who have been diagnosed with language and learning disabilities” (Kamhi, 2011, p. 270).  In other words, if one carefully analyzes the child’s so-called processing issues, one will quickly realize that those issues are not related to the processing of auditory input  (auditory domain) since the child is not processing tones, hoots, or clicks, etc. but rather has difficulty processing speech and language (language domain).

If a student with confirmed or suspected APD is referred to an SLP, it is important, to begin with formal and informal assessments of language and literacy knowledge and skills. (details HERE)   SLPs need to “consider non-auditory reasons for listening and comprehension difficulties, such as limitations in working memory, language knowledge, conceptual abilities, attention, and motivation (Kamhi & Wallach, 2012).

Image result for language goalsAfter performing a comprehensive assessment, SLPs need to formulate language goals based on determined areas of weaknesses. Please note that a systematic review by Fey and colleagues (2011) found no compelling evidence that auditory interventions provided any unique benefit to auditory, language, or academic outcomes for children with diagnoses of (C)APD or language disorder. As such it’s important to avoid formulating goals focused on targeting isolated processing abilities like auditory discrimination, auditory sequencing, recognizing speech in noise, etc., because these processing abilities have not been shown to improve language and literacy skills (Fey et al., 2011; Kamhi, 2011).

Instead, SLPs need to target we need to focus on the language underpinnings of the above skills and turn them into language and literacy goals. For example, if the child has difficulty recognizing speech in noise, improve the child’s knowledge and access to specific vocabulary words.  This will help the child detect the word when the auditory information is degraded.  Child presents with phonemic awareness deficits? Figure out where in the hierarchy of phonemic awareness their strengths and weaknesses lie and formulate goals based on the remaining areas in need of mastery.  Received a description of the child’s deficits from the audiologist in an accompanying report? Turn them into language goals as well!  Turn “prosodic deficits” or difficulty understanding the intent of verbal messages into “listening for details and main ideas in stories” goals.   In other words, figure out the language correlate to the ‘auditory processing’ deficit and replace it.

Image result for quackeryIt is easy to understand the appeal of using dubious practices which promise a quick fix for our student’s “APD deficits” instead of labor-intensive language therapy sessions. But one must also keep something else in mind as well:   Acquiring higher order language abilities takes a significant period of time, especially for those students whose skills and abilities are significantly below age-matched peers.

APD Summary 

  1. There is still no compelling evidence that APD is a stand-alone diagnosis with clear diagnostic criteria.
  2. There is still no compelling evidence that auditory deficits are a “significant risk factor for  language or academic performance.”
  3. There is still no compelling evidence that “auditory interventions provide any unique benefit to auditory, language, or academic outcomes” (Hazan, Messaoud-Galusi, Rosan, Nouwens, & Shakespeare, 2009; Watson & Kidd, 2009).
  4. APD deficits are language based deficits which accompany a host of developmental conditions ranging from developmental language disorders to learning disabilities, etc.
  5. SLPs should perform comprehensive language and literacy assessments of children diagnosed with APD.
  6. SLPs should target   literacy goals.
  7. SLPS should be wary of any goals or recommendations which focus on remediation of isolated skills such as: “auditory discrimination, auditory sequencing, phonological memory, working memory, or rapid serial naming” since studies have definitively confirmed their lack of effectiveness (Fey et al., 2011).
  8. SLPs should be wary of any prescriptive programs offering APD “interventions” and instead focus on improving children’s abilities for functional communication including listening, speaking, reading, and writing (see Wallach, 2014: Improving Clinical Practice: A School-Age and School-Based Perspective).  This article  “presents a conceptual framework for intervention at school-age levels” and discusses “advanced levels of language that move beyond preschool and early elementary grade goals and objectives with a focus on comprehension and meta-abilities.”

There you have it!  Students diagnosed with APD are best served by targeting the language and literacy problems that are affecting their performance in school. 

Related Posts:

 

 

Posted on

A Focus on Literacy

Image result for literacyIn recent months, I have been focusing more and more on speaking engagements as well as the development of products with an explicit focus on assessment and intervention of literacy in speech-language pathology. Today I’d like to introduce 4 of my recently developed products pertinent to assessment and treatment of literacy in speech-language pathology.

First up is the Comprehensive Assessment and Treatment of Literacy Disorders in Speech-Language Pathology

which describes how speech-language pathologists can effectively assess and treat children with literacy disorders, (reading, spelling, and writing deficits including dyslexia) from preschool through adolescence.  It explains the impact of language disorders on literacy development, lists formal and informal assessment instruments and procedures, as well as describes the importance of assessing higher order language skills for literacy purposes. It reviews components of effective reading instruction including phonological awareness, orthographic knowledge, vocabulary awareness,  morphological awareness, as well as reading fluency and comprehension. Finally, it provides recommendations on how components of effective reading instruction can be cohesively integrated into speech-language therapy sessions in order to improve literacy abilities of children with language disorders and learning disabilities.

from wordless books to readingNext up is a product entitled From Wordless Picture Books to Reading Instruction: Effective Strategies for SLPs Working with Intellectually Impaired StudentsThis product discusses how to address the development of critical thinking skills through a variety of picture books utilizing the framework outlined in Bloom’s Taxonomy: Cognitive Domain which encompasses the categories of knowledge, comprehension, application, analysis, synthesis, and evaluation in children with intellectual impairments. It shares a number of similarities with the above product as it also reviews components of effective reading instruction for children with language and intellectual disabilities as well as provides recommendations on how to integrate reading instruction effectively into speech-language therapy sessions.

Improving critical thinking via picture booksThe product Improving Critical Thinking Skills via Picture Books in Children with Language Disorders is also available for sale on its own with a focus on only teaching critical thinking skills via the use of picture books.

Best Practices in Bilingual LiteracyFinally,   my last product Best Practices in Bilingual Literacy Assessments and Interventions focuses on how bilingual speech-language pathologists (SLPs) can effectively assess and intervene with simultaneously bilingual and multicultural children (with stronger academic English language skills) diagnosed with linguistically-based literacy impairments. Topics include components of effective literacy assessments for simultaneously bilingual children (with stronger English abilities), best instructional literacy practices, translanguaging support strategies, critical questions relevant to the provision of effective interventions, as well as use of accommodations, modifications and compensatory strategies for improvement of bilingual students’ performance in social and academic settings.

You can find these and other products in my online store (HERE).

Helpful Smart Speech Therapy Resources:

Posted on

C/APD Update: New Developments on an Old Controversy

In the past two years, I wrote a series of research-based posts (HERE and HERE) regarding the validity of (Central) Auditory Processing Disorder (C/APD) as a standalone diagnosis as well as questioned the utility of it for classification purposes in the school setting.

Once again I want to reiterate that I was in no way disputing the legitimate symptoms (e.g., difficulty processing language, difficulty organizing narratives, difficulty decoding text, etc.), which the students diagnosed with “CAPD” were presenting with.

Rather, I was citing research to indicate that these symptoms were indicative of broader linguistic-based deficits, which required targeted linguistic/literacy-based interventions rather than recommendations for specific prescriptive programs (e.g., CAPDOTS, Fast ForWord, etc.),  or mere accommodations.

I was also significantly concerned that overfocus on the diagnosis of (C)APD tended to obscure REAL, language-based deficits in children and forced SLPs to address erroneous therapeutic targets based on AuD recommendations or restricted them to a receipt of mere accommodations rather than rightful therapeutic remediation.

Today I wanted to update you regarding new developments, which took place since my last blog post was written 1.5 years ago, regarding the validity of “C/APD” diagnosis.

In April 2016, de Wit and colleagues published a systematic review in the Journal of Speech, Language, and Hearing Research. Their purpose was to review research studies describing the characteristics of APD in children and determine whether these characteristics merited a label of a distinct clinical disorder vs. being representative of other disorders.  After they searched 6 databases they chose 48 studies which satisfied appropriate inclusion criteria. Unfortunately, only 1 study had strong methodological quality and what’s even more disappointing, the children in their studies were very dissimilar and presented with incredibly diverse symptomology. The authors concluded that: “the listening difficulties of children with APD may be a consequence of cognitive, language, and attention issues rather than bottom-up auditory processing.”

In other words, because APD is not a distinct clinical disorder, a diagnosis of APD would not contribute anything to the child’s functioning beyond showing that the child is experiencing linguistically based deficits, which bear further investigation.

To continue, you may remember that in my first CAPD post I extensively cited a tutorial written by Dr. David DeBonis, who is an AuD. In his article, he pointed out numerous inconsistencies involved in CAPD testing and concluded that “routine use of CAPD test protocols cannot be supported” and that [CAPD] “intervention needs to be contextualized and functional.”

In July 2016, Iliadou, Sirimanna, & Bamiou published an article: “CAPD Is Classified in ICD-10 as H93.25 and Hearing Evaluation—Not Screening—Should Be Implemented in Children With Verified Communication and/or Listening Deficits” protesting DeBonis’s claim that CAPD is not a unique clinical entity and as such should not be included in any disease classification system.  They stated that DeBonis omitted the fact that “CAPD is included in the U.S. version of the International Statistical Classification of Diseases and Related Health Problems–10th Revision (ICD-10) under the code H93.25” (p. 368). They also listed what they believed to be a number of article omissions, which they claimed biased DeBonis’s tutorial’s conclusions.

The authors claimed that DeBonis provided a limited definition of CAPD based only on ASHA’s Technical report vs. other sources such as American Academy of Audiology (2010), British Society of Audiology Position Statement (2011), and Canadian Guidelines on Auditory Processing Disorder in Children and Adults: Assessment Intervention (2012).  (p. 368)

The also authors claimed that DeBonis did not adequately define the term “traditional testing” and failed to provide several key references for select claims.  They disagreed with DeBonis’s linkage of certain digit tests, as well as his “lumping” of studies which included children with suspected and diagnosed APD into the same category. (p. 368-9)  They also objected to the fact that he “oversimplified” results of positive gains of select computer-based interventions for APD, and that in his summary section he listed only selected studies pertinent to the topic of intelligence and auditory processing skills. (p. 369).

Their main objection, however, had to do with the section of DeBonis’s article that contained “recommended assessment and intervention process for children with listening and communication difficulties in the classroom”.  They expressed concerns with his recommendations on the grounds that he failed to provide published research to support that this was the optimal way to provide intervention. The authors concluded their article by stating that due to the above-mentioned omissions they felt that DeBonis’s tutorial “show(ed) unacceptable bias” (p. 370).

In response to the Iliadou, Sirimanna, & Bamiou, 2016 concerns, DeBonis issued his own response article shortly thereafter (DeBonis, 2016). Firstly, he pointed out that when his tutorial was released in June 2015 the ICD-10 was not yet in effect (it was enacted Oct 1, 2015). As such his statement was factually accurate.

Secondly, he also made a very important point regarding the C/APD construct validity, namely that it fails to satisfy the Sydenham–Guttentag criteria as a distinct clinical entity (Vermiglio, 2014). Namely, despite attempts at diagnostic uniformity, CAPD remains ambiguously defined, with testing failing to “represent a homogenous patient group.” (p. 906).

For those who are unfamiliar with this terminology (as per direct quote from Dr. Vermiglio’s presentation): “The Sydenham-Guttentag Criteria for the Clinical Entity Proposed by Vermiglio (accepted 2014, JAAA) is as follows:

  1. The clinical entity must possess an unambiguous definition (Sydenham, 1676; FDA, 2000)
  2. It must represent a homogeneous patient group (Sydenham, 1676; Guttentag, 1949, 1950; FDA, 2000)
  3. It must represent a perceived limitation (Guttentag, 1949)
  4. It must facilitate diagnosis and intervention (Sydenham, 1676; Guttentag, 1949; FDA, 2000)

Thirdly, DeBonis addressed Iliadou, Sirimanna, & Bamiou, 2016 concerns that he did not use the most recent definition of APD by pointing out that he was most qualified to discuss the US system and its definitions of CAPD, as well as that “the U.S. guidelines, despite their limitations and age, continue to have a major impact on the approach to auditory processing disorders worldwide” (p.372). He also elucidated that: the AAA’s (2010) definition of CAPD is “not so much built on previous definitions but rather has continued to rely on them” and as such does not constitute a “more recent” source of CAPD definitions. (p.372)

DeBonis next addressed the claim that he did not adequately define the term “traditional testing”. He stated that he defined it on pg. 125 of his tutorial and that information on it was taken directly from the AAA (2010) document. He then explained how it is “aligned with bottom-up aspects of the auditory system” by citing numerous references (see p. 372 for further details).  After that, he addressed Iliadou, Sirimanna, & Bamiou, 2016 claim that he failed to provide references by pointing out the relevant citation in his article, which they failed to see.

Next, he proceeded to address their concerns “regarding the interaction between cognition and auditory processing” by reiterating that auditory processing testing is “not so pure” and is affected by constructs such as memory, executive function skills, etc. He also referenced the findings of  Beck, Clarke and Moore (2016)  that “most currently used tests of APD are tests of language and attention…lack sensitivity and specificity” (p. 27).

The next point addressed by DeBonis was the use of studies which included children with suspected vs. confirmed APD. He agreed that “one cannot make inferences about one population from another” but added that the data from the article in question “provided insight into the important role of attention and memory in children who are poor listeners” and that “such listeners represent the population [which] should be [AuD’s] focus.” (p.373)

From there on, DeBonis moved on to address Iliadou, Sirimanna, & Bamiou, 2016 claims that he “oversimplified” the results of one CBAT study dealing with effects of computer-based interventions for APD. He responded that the authors of that review themselves stated that: “the evidence for improving phonological awareness is “initial”.

Consequently, “improvements in auditory processing—without subsequent changes in the very critical tasks of reading and language—certainly do not represent an endorsement for the auditory training techniques that were studied.” (p.373)

Here, DeBonis also raised concerns regarding the overall concept of treatment effectiveness, stating that it should not be based on “improved performance on behavioral tests of auditory processing or electrophysiological measures” but ratheron improvements on complex listening and academic tasks“. (p.373) As such,

  1. “This limited definition of effectiveness leads to statements about the impact of certain interventions that can be misinterpreted at best and possibly misleading.”
  2. “Such a definition of effectiveness is unlikely to be satisfying to working clinicians or parents of children with communication difficulties who hope to see changes in day-to-day communication and academic abilities.” (p.373)

Then, DeBonis addressed Iliadou, Sirimanna, & Bamiou, 2016 concerns regarding the omission of an article supporting CAPD and intelligence as separate entities. He reiterated that the aim of his tutorial was to note that “performance on commonly used tests of auditory processing is highly influenced by a number of cognitive and linguistic factors” rather than to “do an overview of research in support of and in opposition to the construct”. (p.373)

Subsequently, DeBonis addressed the Iliadou, Sirimanna, & Bamiou, 2016 claim that he did not provide research to support his proposed testing protocol, as well as that he made a figure error. He conceded that the authors were correct with respect to the figure error (the information provided in the figure was not sufficient). However, he pointed out that the purpose of his tutorial was to “to review the literature related to ongoing concerns about the use of the CAPD construct in school-aged children and to propose an alternative assessment/intervention procedure that moves away from testing “auditory processing” and moves toward identifying and supporting students who have listening challenges”. As such, while the effectiveness of his model is being tested, it makes sense to “use of questionnaires and speech-in-noise tests with very strong psychometric characteristics” and thoroughly assess these children’s “language and cognitive skills to reduce the chance of misdiagnosis”  in order to provide functional interventions (p.373).

Finally, Debonis addressed the Iliadou, Sirimanna, & Bamiou, 2016 accusation that his tutorial contained “unacceptable bias”. He pointed out that “the reviewers of this [his 2015 article article] did not agree” and that since the time of that article’s publication “readers and other colleagues have viewed it as a vehicle for important thought about how best to help children who have listening difficulties.” (p. 374)

Having read the above information, many of you by now must be wondering: “Why is the research on APD as a valid stand alone diagnosis continues to be published at regular intervals?”

To explain the above phenomenon, I will use several excerpts from an excellent presentation by Kamhi, A, Vermiglio, A, & Wallach, G (2016), which I attended during the 2016 ASHA Convention in Philadephia, PA.

It has been suggested that the above has to do with: “The bias of the CAPD Convention Committee that reviews submissions.” Namely, “The committee only accepts submissions consistent with the traditional view of (C)APD espoused by Bellis, Chermak and others who wrote the ASHA (2005) position statement on CAPD.”

Kamhi Vermiglio, and Wallach (2016) supported this claim by pointing out that when Dr. Vermiglio attempted to submit his findings on the nature of “C/APD” for the 2015 ASHA Convention, “the committee did not accept Vermiglio’s submission” but instead accepted the following seminar: “APD – It Exists! Differential Diagnosis & Remediation” and allocated for it “a prominent location in the program planner.”

Indeed, during the 2016 ASHA convention alone, there was a host of 1 and 2-hour pro-APD sessions such as: “Yes, You CANS! Adding Therapy for Specific CAPDs to an IEP“, “Perspectives on the Assessment & Treatment of Individuals With Central Auditory Processing Disorder (CAPD)“, as well asThe Buffalo Model for CAPD: Looking Back & Forward, in addition to a host of posters and technical reports attempting to validate this diagnosis despite mounting evidence refuting that very fact. Yet only one session, “Never-Ending Controversies With CAPD: What Thinking SLPs & Audiologists Know” presented by Kamhi, Vermiglio, & Wallach (two SLPs and one AuD) and accepted by a non-AuD committee, discussed the current controversies raging in the fields of speech pathology and audiology pertaining to “C/APD”. 

In 2016, Diane Paul, the Director of Clinical Issues in Speech-Language Pathology at ASHA  had asked Kamhi, Vermiglio, and Wallach “to offer comments on the outline of audiology and SLP roles in assessing and treating CAPD”.  According to Kamhi, et al, 2016, the outline did not mention any of controversies in assessment and diagnosis documented by numerous authors dating as far as 2009. It also did not “mention the lack of evidence on the efficacy of auditory interventions documented in the systematic review by Fey et al. (2011) and DeBonis (2015).”

At this juncture, it’s important to start thinking regarding possible incentives a professional might have to continue performing APD testing and making prescriptive program recommendations despite all the existing evidence refuting the validity and utility of APD diagnosis for children presenting with listening difficulties.

Conclusions:

  • There is still no compelling evidence that APD is a stand-alone diagnosis with clear diagnostic criteria
  • There is still no compelling evidence that auditory deficits are a “significant risk factor for  language or academic performance”
  • There is still no compelling evidence that “auditory interventions provide any unique benefit to auditory, language, or academic outcomes” (Hazan, Messaoud-Galusi, Rosan, Nouwens, & Shakespeare, 2009; Watson & Kidd, 2009)
  • APD deficits are linguistically based deficits which accompany a host of developmental conditions ranging from developmental language disorders to learning disabilities, etc.
  • SLPs should continue comprehensively assessing children diagnosed with “C/APD” to determine the scope of their linguistic deficits
  • SLPs should continue formulating language goals to  determine linguistic areas of weaknesses
  • SLPS should be wary of any goals or recommendations which focus on remediation of isolated skills such as: “auditory discrimination, auditory sequencing, phonological memory, working memory, or rapid serial naming” since studies have definitively confirmed their lack of effectiveness (Fey, et al, 2011)
  • SLPs should be wary of any prescriptive programs offering C/APD “interventions”
  • SLPs should focus on improving children’s abilities for functional communication including listening, speaking, reading, and writing
    • Please see excellent article written by Dr. Wallach in 2014 entitled: Improving Clinical Practice: A School-Age and School-Based Perspective. It “presents a conceptual framework for intervention at school-age levels” and discusses “advanced levels of language that move beyond preschool and early elementary grade goals and objectives with a focus on comprehension and meta-abilities.”

So there you have it, sadly, despite research and logic, the controversy is very much alive! Except I am seeing some new developments!

I see SLPs, newly-minted and seasoned alike, steadily voicing their concerns regarding the symptomology they are documenting in children diagnosed with so-called “CAPD” as being purely auditory in nature.

I see more and more SLPs supporting research evidence and science by voicing their concerns regarding the numerous diagnostic markers of ‘CAPD’ which do not make sense to them by stating “Wait a second – that can’t be right!”.

I see more and more SLPs documenting the lack of progress children make after being prescribed isolated FM systems or computer programs which claim to treat “APD symptomology” (without provision of therapy services).  I see more and more SLPs beginning to understand the lack of usefulness of this diagnosis, who switch to using language-based interventions to teach children to listen, speak, read and write and to generalize these abilities to both social and academic settings.

I see more and more SLPs beginning to understand the lack of usefulness of this diagnosis, who switch to using language-based interventions to teach children to listen, speak, read and write and to generalize these abilities to both social and academic settings.

So I definitely do see hope on the horizon!

References:

(arranged in chronological order of citation in the blog post):

Related Posts: