{"version":"https://jsonfeed.org/version/1","title":"Aaron Gustafson: Content tagged inclusive design","description":"The latest 20 posts and links tagged inclusive design.","home_page_url":"https://www.aaron-gustafson.com","feed_url":"https://www.aaron-gustafson.com/feeds/inclusive-design.json","author":{"name":"Aaron Gustafson","url":"https://www.aaron-gustafson.com"},"icon":"https://www.aaron-gustafson.com/i/og-logo.png","favicon":"https://www.aaron-gustafson.com/favicon.png","expired":false,"items":[{"id":"https://www.aaron-gustafson.com/notebook/links/accessibility-in-the-end-of-deterministic-design-again/","title":"🔗 Accessibility in the End of Deterministic Design (Again)","summary":"Accessibility isn’t something generative interfaces will magically solve; it’s the groundwork we need in order to make those systems trustworthy at all.","content_html":"<p>The framing Anna Cook uses for her talk is an important one: accessibility isn’t something generative interfaces will magically solve; it’s the groundwork we need in order to make those systems trustworthy at all.</p>\n<p>I also appreciate the callback in the title. We’ve been here before. The particulars may be new, but the core challenge is familiar: how do we build resilient, inclusive systems when the output is fluid, personalized, or otherwise beyond a designer’s exact control? Accessibility is not a bolt-on answer to that question; it’s where the answer has to begin.</p>\n","social_text":"Accessibility isn’t something generative interfaces will magically solve; it’s the groundwork we need in order to make them trustworthy at all.","url":"https://www.aaron-gustafson.com/notebook/links/accessibility-in-the-end-of-deterministic-design-again/","external_url":"https://www.deque.com/axe-con/sessions/accessibility-in-the-end-of-deterministic-design-again/","tags":["accessibility","AI/ML","inclusive design"],"date_published":"2026-04-29T12:10:00Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/design-systems-cant-automate-away-all-of-your-accessibility-considerations/","title":"🔗 Design systems can’t automate away all of your accessibility considerations","summary":"Eric does an excellent job outlining the kinds of accessibility issues design systems and automated tooling can reduce, but never fully eliminate.","content_html":"<p>Eric does an excellent job outlining the kinds of accessibility issues design systems and automated tooling can reduce, but never fully eliminate.</p>\n<p>This is the part too many teams miss: accessibility doesn’t end at the component boundary. A well-built component library can give you a stronger foundation, but it can’t guarantee the right labels, the right heading structure, the right focus management, or the right overall experience once those pieces are assembled into an interface. That work still requires judgment, care, and testing with actual people.</p>\n","social_text":"Passing automated checks is not the same thing as delivering an accessible experience.","url":"https://www.aaron-gustafson.com/notebook/links/design-systems-cant-automate-away-all-of-your-accessibility-considerations/","external_url":"https://zeroheight.com/blog/design-systems-cant-automate-away-all-of-your-accessibility-considerations/","tags":["accessibility","inclusive design","pattern libraries"],"image":"https://zh-marketing-wordpress-uploads.s3.amazonaws.com/wp-content/uploads/2025/11/blog-feature-computer-yellow.png","date_published":"2026-04-23T12:10:00Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/people-are-not-static-we-are-dynamic-in-order-to-meet-our-needs-at-any-point-in-our-lives-or-day-the-uis-we-create-must-be-able-to-adapt-to-us-not-the-other-way-around-/","title":"🔗 Different contexts, different tools, same person","summary":"People are not static, we are dynamic. In order to meet our needs at any point in our lives or day, the UIs we create must be able to adapt to us — not the other way around.","content_html":"<p>People are not static, we are dynamic. In order to meet our needs at any point in our lives or day, the UIs we create must be able to adapt to us — not the other way around.</p>\n<blockquote>\n<p>I know someone that uses her screen reader on her mobile phone, but when she’s on her desktop computer, she uses a mangifier.</p>\n<p>Different contexts, different tools, same person.</p>\n<p>I know someone that uses voice controls on his computer. He uses direct commands like “Click Contact Us” when he’s near the start of his day, and commands like “Click link, twelve” when he’s near the end of his day with lower energy and less clear speech and a dry mouth.</p>\n<p>Different energy/capacity, same tools, same person.</p>\n<p>I know someone that uses a switch on his computer. He also uses the onscreen keyboard on his computer. The one that he chooses reflects the task he’s trying to accomplish and how he can minimize switching between the tools.</p>\n<p>Different task, same context, same tools, same person.</p>\n<p>Disability is not black and white… it’s every shade of every colour.</p>\n</blockquote>\n","social_text":"People are not static, we are dynamic. In order to meet our needs at any point in our lives or day, the UIs we create must be able to adapt to us — not the other way around.","url":"https://www.aaron-gustafson.com/notebook/links/people-are-not-static-we-are-dynamic-in-order-to-meet-our-needs-at-any-point-in-our-lives-or-day-the-uis-we-create-must-be-able-to-adapt-to-us-not-the-other-way-around-/","external_url":"https://www.linkedin.com/posts/derekfeatherstone_accessibility-disability-activity-7434648295420870656-mH3o","tags":["accessibility","progressive enhancement","inclusive design"],"image":"https://static.licdn.com/aero-v1/sc/h/c45fy346jw096z9pbphyyhdz7","date_published":"2026-03-05T18:38:46Z"},{"id":"https://www.aaron-gustafson.com/notebook/accessibility-assistant-for-figma-v52/","title":"✍🏻 Accessibility Assistant for Figma v52","summary":"I just hit “publish” on Accessibility Assistant for Figma v52 and I wanted to share some details on why this is a monumental release for us.","content_html":"<p>I just hit “publish” on <a href=\"https://www.figma.com/community/plugin/731310036968334777/accessibility-assistant\">Accessibility Assistant for Figma</a> v52 and I wanted to share some details on why this is a monumental release for us.</p>\n<p>We’re in the process of a major overhaul to this plugin. There was a lot of infrastructural work to do to modernize the plugin and set the stage for a host of new features to make designers more productive when it comes to making their designs more accessible. This release incorporates a lot of that foundational work, notably:</p>\n<ul>\n<li>Annotations are now presented as Figma-native Dev Mode annotations; this greatly reduces the working overhead of the plugin and reduces visual clutter in the document. We’ve also color-coordinated the icons in the Annotation Set viewer to the labels you see in the Dev Mode annotations, making it easier to scan.</li>\n<li>Legacy annotation tables will automatically be migrated into the new system. The visual readout tables will be hidden when this happens, but are still accessible if you need to copy or reference them. We’ve also included a tool to clean up these old layers when you’re ready.</li>\n<li>Annotations are now managed in a single UI rather than being separated, based on whether they impact focus order. This means you don’t need to jump back &amp; forth between tools to properly annotate your designs.</li>\n<li>We’ve organized and expanded the list of W3C roles available in the role picker. Additionally, the form now adapts to the role, offering you only the relevant fields and reducing distraction. We also added a description field, should you need it.</li>\n</ul>\n<p>We also fixed bugs related to duplicating layers. You can now copy layers and the annotations will go along for the ride, becoming a new Annotation Set. Similarly, you can now duplicate pages and the annotations — which are page-bound — will be re-generated. It’s worth noting that this may take some time on particularly large pages.</p>\n<p>This release has been a long time coming, but I’m incredibly proud of the team that’s been working so diligently on this, particularly Ashish Singh from HCL and Michael Fairchild, Scott O’Hara, and Ben Truelove from Microsoft. Their attention to detail and encyclopedic knowledge of accessibility has been instrumental in getting this project to the place that it is.</p>\n<p>And there’s more to come!</p>\n","social_text":"I just hit “publish” on Accessibility Assistant for Figma v52 and I wanted to share some details on why this is a monumental release for us.","url":"https://www.aaron-gustafson.com/notebook/accessibility-assistant-for-figma-v52/","tags":["accessibility","design","inclusive design","Microsoft","user experience","WAI-ARIA"],"date_published":"2026-02-20T23:27:28Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/some-blind-fans-to-experience-super-bowl-with-tactile-device-that-tracks-ball/","title":"🔗 Some blind fans to experience Super Bowl with tactile device that tracks ball","content_html":"<p>A few years ago, a couple students at the University of Washington asked me to come to their campus for a visit. They gave me a demo of an early prototype they’d been working on — a haptic feedback device that could allow someone who is Blind or low vision to follow a game. The demo took video data from a tennis match and mapped it onto the haptic tablet. It felt like Pong, but they had a bolder vision — tackling fast-moving and complicated sports like basketball, football, American football, and hockey.</p>\n<p>I immediately invited them to pitch us for the AI for Accessibility Grant Program that I ran for Microsoft. With so much focus on assistive technology to enable folks to work and accomplish common life tasks, I loved that the OneCourt team was interested in enabling people with disabilities to enjoy leisure activities like sporting events. Moreover, I saw the potential to enable Blind and low-vision parents to experience their kids’ sporting events, which could be life-changing for them.</p>\n<p>Needless to say, they wowed both me and the rest of the seleciton committee. We funded them to expand their prototypes and pursue partnerships with different professional sports leagues, teams, and venues. They were ambitious and it’s paying off.</p>\n<p>Fast forward a few years and they’re enabling a handful of Blind &amp; low vision sports fans to exerience the Super Bowl in a whole new way, using their technology. It’s amazing and I could not be more proud of them.</p>\n<p>Congrats y’all!</p>\n","social_text":"So proud of the OneCourt team for their work in bringing more leisure opportunities to the Blind & low vision community.","url":"https://www.aaron-gustafson.com/notebook/links/some-blind-fans-to-experience-super-bowl-with-tactile-device-that-tracks-ball/","external_url":"https://apnews.com/article/nfl-blind-fans-super-bowl-6daf12a08127c46c23dab6100a659681","tags":["accessibility","inclusive design","AI/ML"],"image":"https://dims.apnews.com/dims4/default/9b439cc/2147483647/strip/true/crop/5333x3554+0+1/resize/980x653!/quality/90/?url=https%3A%2F%2Fassets.apnews.com%2F1b%2Fe5%2F28e0bd88c1be654d380ee1c3b2f2%2F9a7b2e31c9464fa6a86eb6d04b0a3266","date_published":"2026-02-06T19:40:06Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/disability-personas-from-a-web-for-everyone/","title":"🔗 Disability Personas from A Web for Everyone","summary":"The disability personas contained in Sarah Horton &amp;amp; Whitney Quesenbery’s A Web for Everyone are a terrific resource, so I’m thrilled their available beyond the book now too.","content_html":"<p>The disability personas contained in Sarah Horton &amp; Whitney Quesenbery’s <cite>A Web for Everyone</cite> are a terrific resource, so I’m thrilled their available beyond the book now too.</p>\n","social_text":"I ❤️ these disability personas. What an amazing resource!","url":"https://www.aaron-gustafson.com/notebook/links/disability-personas-from-a-web-for-everyone/","external_url":"https://knowaboutaccessibility.org/category/resources/","tags":["accessibility","inclusive design","user experience"],"date_published":"2025-05-09T23:05:56Z"},{"id":"https://www.aaron-gustafson.com/speaking-engagements/expanding-accessibility-with-ai/","title":"📢 Expanding Accessibility with AI","summary":"This session, hosted by Aaron Gustafson and Ioana Tanase explores the transformative role of AI in enhancing accessibility. Together, you will uncover the pivotal role AI plays in crafting cutting-edge accessible technologies, learn about innovative AI tools that empower individuals with disabilities, and dive into best practices for creating inclusive AI solutions. Together, we will also explore the exciting future of AI in pushing the boundaries of accessibility.","content_html":"<p>This session, hosted by Aaron Gustafson and Ioana Tanase explores the transformative role of AI in enhancing accessibility. Together, you will uncover the pivotal role AI plays in crafting cutting-edge accessible technologies, learn about innovative AI tools that empower individuals with disabilities, and dive into best practices for creating inclusive AI solutions. Together, we will also explore the exciting future of AI in pushing the boundaries of accessibility.</p>\n<p>Learning objectives:</p>\n<ol>\n<li>Understand the pivotal role AI plays in crafting cutting-edge accessible technologies.</li>\n<li>Learn about innovative AI tools that empower individuals with disabilities.</li>\n<li>Dive into best practices for creating inclusive AI solutions.</li>\n<li>Explore the exciting future of AI in pushing the boundaries of accessibility</li>\n</ol>\n","social_text":"This session, hosted by Aaron Gustafson and Ioana Tanase explores the transformative role of AI in enhancing accessibility. Together, you will uncover the pivotal role AI plays in crafting cutting-edge accessible technologies, learn about innovative AI tools that empower individuals with disabilities, and dive into best practices for creating inclusive AI solutions. Together, we will also explore the exciting future of AI in pushing the boundaries of accessibility.","url":"https://www.aaron-gustafson.com/speaking-engagements/expanding-accessibility-with-ai/","tags":["accessibility","AI/ML","inclusive design","the future","user experience","voice UX"],"image":"https://www.aaron-gustafson.com/undefined","date_published":"2024-12-11T08:08:30Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/why-i-care-deeply-about-web-accessibility-and-you-should-too/","title":"🔗 Why I Care Deeply About Web Accessibility And You Should Too","content_html":"<p>I agree with so much of this piece… especially <a href=\"https://www.aaron-gustafson.com/speaking-engagements/delivering-critical-information-services/\">the expansive view of accessibility that is inclusive of both the disability divide and the digital divide</a>.</p>\n<p>Great summary here:</p>\n<blockquote>\n<p>[M]y passion for accessibility stems from experiencing accessibility barriers personally, observing their impact on others, and holding the conviction that technology should tear down divides - not erect new ones. I want to fulfill, and help you fulfill, the web’s promise of equal access and opportunity for everyone, regardless of circumstances. Digital accessibility should not be an accommodation but a fundamental right and prerequisite for technology to truly better humanity.</p>\n</blockquote>\n","social_text":"I agree with so much of this piece, especially the expansive view of accessibility that is inclusive of both the disability divide and the digital divide.","url":"https://www.aaron-gustafson.com/notebook/links/why-i-care-deeply-about-web-accessibility-and-you-should-too/","external_url":"https://dev.to/schalkneethling/why-i-care-deeply-about-web-accessibility-and-you-should-too-274a","tags":["accessibility","inclusive design","performance"],"date_published":"2024-05-09T17:36:18Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/steve-gleason-interview-with-jenny-lay-flurrie/","title":"🔗 Steve Gleason interview with Jenny Lay-Flurrie","content_html":"<p>My boss, Jenny Lay-Flurrie, went to New Orleans to interview Steve Gleason about his new book and so much more. It was originally recorded for an internal interview series, but we’ve made it public because it’s such an amazing conversation. Well worth your time.</p>\n","social_text":"Love this conversation between @JennyLayFluffy and @SteveGleason about life, music, technology, and resilience. 😍","url":"https://www.aaron-gustafson.com/notebook/links/steve-gleason-interview-with-jenny-lay-flurrie/","external_url":"https://www.youtube.com/watch?v=6zcGGdO4e98","tags":["accessibility","AI/ML","inclusive design"],"date_published":"2024-05-01T21:21:35Z"},{"id":"https://www.aaron-gustafson.com/speaking-engagements/embedding-accessibility/","title":"📢 Embedding Accessibility","summary":"In this session, I discuss the many reasons companies should prioritize accessibility, how to build a culture of accessibility, and what it can mean for their bottom line.","content_html":"<p>In this session, I discuss the many reasons companies should prioritize accessibility, how to build a culture of accessibility, and what it can mean for their bottom line.</p>\n","social_text":"In this session, I discuss the many reasons companies should prioritize accessibility, how to build a culture of accessibility, and what it can mean for their bottom line.","url":"https://www.aaron-gustafson.com/speaking-engagements/embedding-accessibility/","tags":["accessibility","inclusion","inclusive design","progressive enhancement","user experience"],"image":"https://www.aaron-gustafson.com/undefined","date_published":"2024-01-19T08:08:00Z"},{"id":"https://www.aaron-gustafson.com/appearances/press/2023-12-11-ai-for-non-standard-speech-and-inclusive-gps-meet-the-impact-startups-using-tech-to-tackle-the-disability-divide/","title":"🎤 AI for non-standard speech and inclusive GPS: Meet the impact startups using tech to tackle the disability divide","content_html":"<p>The folks over at <cite>Sifted</cite> asked me to weigh in on the potential of AI to increase access and inclusivity. They frame the opportunity perfectly:</p>\n<blockquote>\n<p>Excitement around how AI can change the way we live and work has reached fever pitch — but less often discussed is how it could create a more inclusive, accessible world. Yet the opportunity is vast. <cite>Sifted</cite> estimates the addressable market for disability tech is somewhere in the 2bn range, while PwC predicts AI could contribute nearly $16tn to the global economy by 2030.</p>\n</blockquote>\n","url":"https://sifted.eu/articles/disability-tech-brnd","tags":["accessibility","AI/ML","inclusive design"],"date_published":"2023-12-11T00:00:00Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/tolu-adegbite/","title":"🔗 Tolu Adegbite","content_html":"<p>Excellent interview with Tolu Adegbite on her career and the importance of giving voice to other marginalized communities within the disability space.</p>\n","social_text":"Excellent interview with Tolu Adegbite on her career and the importance of giving voice to other marginalized communities within the disability space.","url":"https://www.aaron-gustafson.com/notebook/links/tolu-adegbite/","external_url":"https://revisionpath.com/tolu-adegbite/","tags":["accessibility","inclusive design"],"image":"https://revisionpath.com/wp-content/uploads/tolu-adegbite-300.png","date_published":"2023-09-19T03:47:11Z"},{"id":"https://www.aaron-gustafson.com/notebook/opportunities-for-ai-in-accessibility/","title":"✍🏻 Opportunities for AI in Accessibility","summary":"I want to take a little time to talk about the potential of AI to aid in accessibility, in hopes we’ll get there one day.","content_html":"<p>In reading through <a href=\"https://www.joedolson.com/2023/06/accessibility-and-artificial-intelligence/\">Joe Dolson’s recent piece on the intersection of AI and accessibility</a>, I absolutely appreciated the skepticism he has for AI in general as well as the ways in which many have been using it. In fact, I am very skeptical of AI myself, despite my role at Microsoft being that of an Accessibility Innovation Strategist helping run the AI for Accessibility grant program. As with any tool, AI can be used in very constructive, inclusive, and accessible ways <em>and</em> it can be used in destructive, exclusive, and harmful ones. And there are a ton of uses somewhere in the mediocre middle as well.</p>\n<p>I’d like you to consider this a “yes… and” piece to complement Joe’s post. I don’t seek to refute any of what he’s saying, but rather provide some visibility to projects and opportunities where AI can make a meaningful difference for people with disabilities (PwD) across the globe. To be clear, I am not saying there aren’t real risks and pressing issues with AI that need to be addressed—there are, and we needed to address them like yesterday—but I want to take a little time to talk about what’s possible, in hopes we’ll get there one day.</p>\n<h2 id=\"alternative-text\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#alternative-text\" aria-hidden=\"true\">#</a> Alternative text</h2>\n<p>Joe’s piece spends a lot of time talking about computer vision models generating alternative text. He highlights a ton of valid issues with the current state of things. And while computer vision models continue to improve in terms of the quality and richness of detail in their descriptions, the results are not great. As he rightly points out, the current state of image analysis is pretty poor—especially for certain image types—and the current systems examine images in isolation rather than within the context in which they sit (a consequence of having separate foundation models for text analysis and image analysis).</p>\n<p>These models are also not currently trained to distinguish an image that is contextually relevant (for which there should probably be a description) from one that is purely decorative. Of course this is something we humans struggle with as well… the right answer is often somewhere between the author’s intent and the user’s needs/preferences.</p>\n<p>All of that said, there is potential in this space.</p>\n<p>As Joe mentions, human-in-the-loop authoring of <code>alt</code> text should absolutely be a thing. And if AI can pop in to offer a starting point—even if that starting point is prompting you to say <em>What is this B.S.? That’s not right at all… let me fix it</em>—I think that’s a win.</p>\n<p>Taking things a step further, if we can specifically train a model to analyze image usage in context, it could help us more quickly identify which ones are likely to be presentational and which ones likely require a description. That will help reinforce the importance of descriptions in the appropriate context <em>and</em> improve the efficiency with which authors can make their pages more accessible.</p>\n<p>While complex images—graphs, charts, etc.—are challenging to describe in any sort of succinct way (even for humans), <a href=\"https://openai.com/research/gpt-4#:~:text=Visual%20inputs:%20VGA%20charger\">the image example shared in the GPT4 announcement</a> points to an interesting opportunity here as well. Let’s say the description of a chart was simply the title of the chart and the kind of visualization it was. For example: <em>Pie chart comparing smartphone usage to feature phone usage among U.S. households making under $30,000 a year.</em> If the browser knows it’s a pie chart (because an onboard model verified this), imagine a world where a user could ask questions about the graphic.</p>\n<ul>\n<li><em>Do more people use smartphones or feature phones?</em></li>\n<li><em>How many more?</em></li>\n<li><em>Is there a group of people that don’t fall into either of these buckets?</em></li>\n<li><em>How many is that?</em></li>\n</ul>\n<p>Setting aside the realities of <a href=\"https://machinelearningmastery.com/a-gentle-introduction-to-hallucinations-in-large-language-models/\">Large Language Model (LLM) hallucinations</a> for a moment, the opportunity to interface with image data in this way could be revolutionary for blind and low-vision folks as well as people with various forms of color blindness, cognitive disabilities, and so on. It could also be useful in an educational context to teach people who <em>can</em> see the chart, as authored, to read a pie chart.</p>\n<p>Taking things a step further, what if you could ask your browser to simplify a complex chart, perhaps isolating a single line on a line graph? What if you could ask the browser to transpose the colors of the different lines to work better for the specific form of color blindness you have? What if you could swap colors for patterns? Given the chat-based interface and our ability to manipulate existing images in currently available AI tools, that certainly seems like a possible future.</p>\n<p>Now imagine a purpose-built model that could extract the information from that chart and convert it to another format. For example, it could turn that pie chart (or better yet, a series of them) into a more accessible (and useful) format like a spreadsheet. That would be amazing!</p>\n<h2 id=\"matching-algorithms\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#matching-algorithms\" aria-hidden=\"true\">#</a> Matching Algorithms</h2>\n<p>Safiya Umoja Noble absolutely hit the nail on the head with the title of her book <a href=\"http://algorithmsofoppression.com/\"><em>Algorithms of Oppression</em></a>. While it was focused on search engines reinforcing racism, all computer models have the potential to amplify conflict, bias, and intolerance. Whether it’s Twitter always showing you the latest tweet from a bored billionaire, YouTube sending us into a Q-hole, or Instagram warping our idea of what a natural body looks like, we know poorly authored and maintained algorithms are incredibly harmful. A lot of this stems from a lack of diversity among the people who shape and/or build them. When built inclusively, however, there is real potential for algorithm development to benefit people with disabilities.</p>\n<p>Take <a href=\"https://www.mentra.com/\">Mentra</a>, for example. They are an employment network for neurodivergent people. They employ an algorithm to match job seekers with potential employers, based on over 75 different data points. On the job seeker side of things, it takes into account the candidate’s strengths, necessary workplace accommodations (and preferred ones), environmental sensitivities, and so on. On the employer side, it takes into account the work environment, communication factors related to the job, and the like. As a company run by neurodivergent folks, Mentra made the decision to flip the script when it comes to typical employment sites. They use their algorithm to propose available candidates to the companies, who can then connect with job seekers they are interested in; reducing the emotional and physical labor on the job seeker side of things.</p>\n<p>When more people with disabilities are involved in the creation of algorithms, there is a lessened likelihood that these algorithms will be used to inflict harm on their communities. This is why diverse teams are so important.</p>\n<p>Imagine if a social media company’s recommendation engine was tuned to analyze who you’re currently following and prioritized recommending that you follow people who talked about similar things, but who were different in some key way from your existing sphere of influence. For example, if you follow a bunch of non-disabled white male academics who talk about AI, it could suggest you follow academics who are disabled or aren’t white or aren’t male who also talk about AI. If you took its recommendations, you’d likely get a much more holistic and nuanced understanding of what is happening in the AI field.</p>\n<h2 id=\"other-ways-ai-helps-pwd\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#other-ways-ai-helps-pwd\" aria-hidden=\"true\">#</a> Other Ways AI Helps PwD</h2>\n<p>If I weren’t trying to put this together between other tasks, I’m sure I could go on, <i lang=\"la\">ad infinitum</i>, providing all kinds of examples of how AI can be used to the benefit of people with disabilities, but I’m going to make this last section into a bit of a lightning round. In no particular order:</p>\n<ul>\n<li><strong>Voice preservation.</strong> You may have seen <a href=\"https://arxiv.org/abs/2301.02111\">the VALL-E paper</a> or <a href=\"https://www.apple.com/newsroom/2023/05/apple-previews-live-speech-personal-voice-and-more-new-accessibility-features/\">Apple’s GAAD announcement</a> or you may be familiar with offerings from <a href=\"https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/custom-neural-voice\">Microsoft</a>, <a href=\"https://www.acapela-group.com/voices/voice-banking/\">Acapela</a>, and others. It is possible to train an AI model to replicate your voice, which is tremendous for people who have ALS/MDN and other medical conditions that lead to dysarthria. This is, of course, the same tech that can be used to create audio deepfakes, so it’s something we need to approach <em><a href=\"https://www.microsoft.com/en-us/ai/responsible-ai\">responsibly</a></em>, but the tech has truly transformative potential.</li>\n<li><strong>Voice recognition.</strong> Researchers like those in the <a href=\"https://speechaccessibilityproject.beckman.illinois.edu/\">Speech Accessibility Project</a> are paying people with disabilities for their assistance in collecting recordings of people with atypical speech. As I type, they are actively recruiting people with Parkinson’s and related conditions and they have plans to expand this to other etiologies as the project progresses. This research will result in more inclusive data sets that will enable more people with disabilities to use voice assistants, dictation software, and voice response services as well as control their computers and other devices more easily, using only their voice.</li>\n<li><strong>Text transformation.</strong> The current generation of LLMs is quite capable of making adjustments to existing text content without injecting hallucinations. This is hugely empowering for people with cognitive disabilities who may benefit from a text summary or the text being simplified or even from it being prepped for <a href=\"https://bionic-reading.com/\">bionic reading</a>.</li>\n</ul>\n<h2 id=\"the-importance-of-diverse-teams-and-data\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#the-importance-of-diverse-teams-and-data\" aria-hidden=\"true\">#</a> The Importance of Diverse Teams and Data</h2>\n<p>Of course to do things like this, we need to recognize that differences do matter. Our lived experiences are influenced by the intersections of identity in which we exist. Those lived experiences—with all of their complexity (and joy and pain)—are valuable inputs to the software, services, and societies we shape. They need to be represented in the data we use to train new models and the folks who contribute that valuable information need to be compensated for sharing it with us. Inclusive data sets yield more robust models that enable more equitable outcomes.</p>\n<p>Want a model that doesn’t demean or patronize or objectify people with disabilities? Make sure content about disability, authored by people with a range of disabilities is well-represented in the training data.</p>\n<p>Want a model that doesn’t use ableist language? Use <a href=\"https://www.selfdefined.app/\">existing data sets</a> to build a filter that can intercept and remediate ableist language before it reaches an end user.</p>\n<p>Want a coding co-pilot that gives you accessible recommendations from the jump? Train it on code that is known to be accessible.</p>\n<hr>\n<p>I have no doubt that AI can and will harm people… today, tomorrow, and well into the future. However, I also believe that we can acknowledge that and, with an eye towards accessibility (and, more broadly, inclusion), make thoughtful, considerate, intentional changes in our approaches to AI that will reduce harm over time as well. Today, tomorrow, and well into the future.</p>\n","social_text":"A rumination on #AI and #accessibility","url":"https://www.aaron-gustafson.com/notebook/opportunities-for-ai-in-accessibility/","tags":["accessibility","AI/ML","inclusive design","the future"],"image":"https://www.aaron-gustafson.com/i/posts/2023-06-09/hero.jpg","date_published":"2023-06-09T21:57:16Z"},{"id":"https://www.aaron-gustafson.com/notebook/considering-content-warnings-in-html/","title":"✍🏻 Considering content warnings in HTML","summary":"Prompted by a recent suggestion in the Web We Want inbox, I gave some thought to the potential for allowing authors to provide content warnings in their markup.","content_html":"<p>One of the features I really love about Mastodon is their first-class Content Warning feature. With one additional step, you can add any warning of your choice to your post and it will be hidden by default, showing only the content warning text. It’s a super-simple idea, but so powerful when it comes to reducing potential the likelihood of causing our readers to experience the kinds of trauma that could have severe consequences.</p>\n<p>Earlier today, <a href=\"https://github.com/WebWeWant/webwewant.fyi/issues/615\">the idea of a “spoiler / content warning” element popped onto my radar through the Web We Want inbox</a>. It referenced <a href=\"https://discourse.wicg.io/t/standardized-spoiler-tag/5814\">a discussion over on the WICG</a> and I was intrigued but the potential of this kind of feature for HTML. Some folks suggested progressive disclosures like <code>details</code>/<code>summary</code> was the way to go, but that approach is limited to flow content (and fraught with a host of issues).</p>\n<h2 id=\"markup-possibilities\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#markup-possibilities\" aria-hidden=\"true\">#</a> Markup possibilities</h2>\n<p>I wasn’t sold on the idea of a <code>spoiler</code> element either, as that’s a pretty specific use case of a content warning. And so I wondered, <em>what if instead of an element, we introduced an attribute that could take the kind of content warning as its value</em>. For example, consider the following:</p>\n<pre class=\"language-html\" tabindex=\"0\"><code class=\"language-html\"><span class=\"token tag\"><span class=\"token tag\"><span class=\"token punctuation\">&lt;</span>article</span> <span class=\"token attr-name\">content-warning</span><span class=\"token attr-value\"><span class=\"token punctuation attr-equals\">=</span><span class=\"token punctuation\">\"</span>child abuse<span class=\"token punctuation\">\"</span></span><span class=\"token punctuation\">></span></span>… article contents …<span class=\"token tag\"><span class=\"token tag\"><span class=\"token punctuation\">&lt;/</span>article</span><span class=\"token punctuation\">></span></span></code></pre>\n<p>This would identify the entire article as discussing child abuse. Obscuring that behind a warning would probably be a good idea.</p>\n<p>Or perhaps the content warning should apply to an image:</p>\n<pre class=\"language-html\" tabindex=\"0\"><code class=\"language-html\"><span class=\"token tag\"><span class=\"token tag\"><span class=\"token punctuation\">&lt;</span>img</span> <span class=\"token attr-name\">content-warning</span><span class=\"token attr-value\"><span class=\"token punctuation attr-equals\">=</span><span class=\"token punctuation\">\"</span>violence gore<span class=\"token punctuation\">\"</span></span> <span class=\"token attr-name\">…</span> <span class=\"token punctuation\">/></span></span></code></pre>\n<p>Or, to return to the original idea of a spoiler, it could also be applied inline:</p>\n<pre class=\"language-html\" tabindex=\"0\"><code class=\"language-html\">I thoroughly enjoyed the film, especially when it was revealed that\n<span class=\"token tag\"><span class=\"token tag\"><span class=\"token punctuation\">&lt;</span>b</span> <span class=\"token attr-name\">content-warning</span><span class=\"token attr-value\"><span class=\"token punctuation attr-equals\">=</span><span class=\"token punctuation\">\"</span>spoiler<span class=\"token punctuation\">\"</span></span><span class=\"token punctuation\">></span></span>Taye Diggs had been the bad guy all along<span class=\"token tag\"><span class=\"token tag\"><span class=\"token punctuation\">&lt;/</span>b</span><span class=\"token punctuation\">></span></span>.</code></pre>\n<h2 id=\"necessary-behaviors\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#necessary-behaviors\" aria-hidden=\"true\">#</a> Necessary behaviors</h2>\n<p>When considering how content behind a warning should be handled, there are a few things that jump immediately to mind:</p>\n<ol>\n<li>Indicated content should be obscured by default.</li>\n<li>Users must choose to reveal the content.</li>\n<li>Content should not be included in the “find in page” index.</li>\n<li>Images should not be downloaded until they are requested (or there is a good chance they will be needed).</li>\n</ol>\n<p>There’s also an interesting opportunity for browsers to offer user preferences around this approach as well. For example, I may never want to be shown content that deals with rape, so I could configure that in my preferences and the browser could take additional steps to hide that content from me or at least make sure I actually want to reveal it by requiring a second step for final approval (i.e., <em>Are you actually sure you want to see this?</em>).</p>\n<h2 id=\"demo\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#demo\" aria-hidden=\"true\">#</a> Demo</h2>\n<p>I threw together <a href=\"https://codepen.io/aarongustafson/pen/rNqjeqj\">a quick &amp; dirty demo of what the experience could be like</a> on Codepen if you’d like to take a look:</p>\n<figure id=\"2023-04-21-01\">\n<iframe class=\"codepen\" height=\"500\" style=\"width:100%;\" scrolling=\"no\" title=\"CodePen Embed\" src=\"https://codepen.io/anon/embed/rNqjeqj?height=500&theme-id=dark&default-tab=result\" frameborder=\"0\" loading=\"lazy\" allowtransparency=\"true\" allowfullscreen=\"true\"><p><a href=\"https://codepen.io/aarongustafson/pen/rNqjeqj\" target=\"_blank\" rel=\"noopener\">See the Pen</a></p></iframe>\n</figure>\n<p>It’s still a work-in-progress, but it’s a starting point. Ideally the browser would handle all of this directly, rather than us having to author CSS and/or JavaScript to implement the feature ourselves. (Though maybe we could get access to style parts of the overlay.)</p>\n<h2 id=\"thoughts%3F\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#thoughts%3F\" aria-hidden=\"true\">#</a> Thoughts?</h2>\n<p>What do you think? Is this something you’d like to see on the web? I’d love to hear your thoughts, which you can share by Webmention-ing this post or referencing it on Mastodon.</p>\n<h2 id=\"update-2023-04-24\" tabindex=\"-1\"><a class=\"header-anchor\" href=\"#update-2023-04-24\" aria-hidden=\"true\">#</a> Update 2023-04-24</h2>\n<p><a href=\"https://mastodon.world/@siblingpastry/110254145981433059\">James Edwards mentioned the potential interplay issues with Reader Mode (and similar)</a> so I started playing around with an alternate approach. I landed on a version that physically swaps out the elements in the DOM for a custom element <code>content-warning</code> that acts as a placeholder. Here’s how it works:</p>\n<ol>\n<li>Author uses <code>content-warning</code> attribute as described above.</li>\n<li>The runtime script swaps that element for the custom <code>content-warning</code> element, which contains a wrapper element (<code>span</code>) that is sized to occupy the same space as the original element (including margins).</li>\n<li>The content warning text is used to label a <code>button</code> inside that wrapper.</li>\n<li>Clicking the <code>button</code> swaps the original element back into position and announces it to screen reader users (using <code>role=&quot;alert&quot;</code>).</li>\n</ol>\n<p>I tested this approach with VoiceOver and JAWS and it works a treat. I also confirmed the Edge’s Reader Mode does not deliver the hidden content.</p>\n<figure id=\"2023-04-21-02\">\n<iframe class=\"codepen\" height=\"500\" style=\"width:100%;\" scrolling=\"no\" title=\"CodePen Embed\" src=\"https://codepen.io/anon/embed/QWZpqPe?height=500&theme-id=dark&default-tab=result\" frameborder=\"0\" loading=\"lazy\" allowtransparency=\"true\" allowfullscreen=\"true\"><p><a href=\"https://codepen.io/aarongustafson/pen/QWZpqPe\" target=\"_blank\" rel=\"noopener\">See the Pen</a></p></iframe>\n</figure>\n<p>Note: The browser doing the work of my demo would be much faster as it could do all the size calculations prior to rendering. I am having to fake that in JavaScript, so I have to peg it to the window’s <code>onload</code> event to ensure all CSS is applied to get the size calculations right.</p>\n","social_text":"Prompted by a recent suggestion in the @WebWeWantFYI inbox, I gave some thought to the potential for content warnings in HTML markup.","url":"https://www.aaron-gustafson.com/notebook/considering-content-warnings-in-html/","tags":["HTML","inclusive design"],"image":"https://www.aaron-gustafson.com/i/posts/2023-04-21/hero.jpg","date_published":"2023-04-21T22:15:48Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/metallica-releasing-asl-videos-for-all-of-their-72-seasons-songs/","title":"🔗 Metallica Releasing ASL Videos for All of Their ’72 Seasons’ Songs","content_html":"<p>I’m not a metal fan, but I love everything about this: Metallica’s new record, <cite>72 Seasons<cite>, will have an ASL interpretation video for every song!</p>\n<p>First up, the title track, “72 Seasons”:</p>\n<p><a href=\"https://www.youtube.com/watch?v=aUhUGvFrBOs\">https://www.youtube.com/watch?v=aUhUGvFrBOs</a></p>\n<p>I absolutely love Amber Galloway’s signing (and enthusiasm) on this video. Kudos to Metallica for doing this!</p>\n","social_text":"I love everything about this: @Metallica’s new record, 72 Seasons, will have an #ASL interpretation video for every song!","url":"https://www.aaron-gustafson.com/notebook/links/metallica-releasing-asl-videos-for-all-of-their-72-seasons-songs/","external_url":"https://www.rollingstone.com/music/music-news/metallica-american-sign-language-videos-72-seasons-1234715949/","tags":["accessibility","inclusive design"],"image":"https://www.rollingstone.com/wp-content/uploads/2023/04/MetallicaSL.jpg","date_published":"2023-04-20T17:49:19Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/why-apca-as-a-new-contrast-method-/","title":"🔗 Why APCA as a New Contrast Method?","content_html":"<p>This piece offers a solid introduction to the Accessible Perceptual Contrast Algorithm (APCA). This algorithm is part of WCAG 3.0 and will replace the contrast algorithm present in WCAG 2.x. It prioritizes perceived contrast and readability.</p>\n<p>Here is an excellent testing tool as well: <a href=\"https://www.color-contrast.dev/\">https://www.color-contrast.dev/</a></p>\n","social_text":"Solid intro to the Accessible Perceptual Contrast Algorithm (#APCA), which will be the updated #contrast algorithm in #WCAG3.","url":"https://www.aaron-gustafson.com/notebook/links/why-apca-as-a-new-contrast-method-/","external_url":"https://git.apcacontrast.com/documentation/WhyAPCA","tags":["accessibility","inclusive design"],"date_published":"2023-03-27T19:53:21Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/microsoft-s-new-inclusive-design-toolkit-is-designed-for-the-brain/","title":"🔗 Microsoft&#39;s new Inclusive Design toolkit is designed for the brain","content_html":"<p>The <a href=\"https://inclusive.microsoft.design/\">Microsoft Inclusive Design Toolkit</a> has gotten an update that <a href=\"https://inclusive.microsoft.design/tools-and-activities/InclusiveDesignForCognitionGuidebook.pdf\">incorporates cognition</a>, which is awesome! It puts forward three new principles:</p>\n<blockquote>\n<ol>\n<li>Understand the user’s motivation, and the goals and tasks they are trying to complete.</li>\n<li>Discern the cognitive load required to reduce that mismatch.</li>\n<li>Co-create the final product with a diverse community of people across the spectrum.</li>\n</ol>\n</blockquote>\n<p>It’s so great to see this seminal resource continuing to evolve.</p>\n","social_text":"The latest revision to the @Microsoft #InclusiveDesign Toolkit includes new considerations for how we think.","url":"https://www.aaron-gustafson.com/notebook/links/microsoft-s-new-inclusive-design-toolkit-is-designed-for-the-brain/","external_url":"https://www.fastcompany.com/90859704/microsofts-new-inclusive-design-toolkit-designed-for-the-brain","tags":["inclusive design","accessibility"],"date_published":"2023-03-07T21:50:10Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/how-ux-designers-can-engage-their-imagination/","title":"🔗 How UX designers can engage their imagination","content_html":"<p>So much worthy of reflecting on on this piece!</p>\n<blockquote>\n<p>I do not believe you can codesign your way to justice.</p>\n<p>Certain institutions and design ideas are fundamentally oppressive, and the only way to achieve radical transformation at scale is with collective action and policy change.</p>\n</blockquote>\n<p>Imagination is key, but imagination in the right way:</p>\n<blockquote>\n<p>Imagination is not a splashy poster of a sci-fi movie but a daily act of resistance we must engage in despite how tired we might be.</p>\n</blockquote>\n<p>Following this framing, author Alba Villamil walls through a ton of actionable above and examples of how to bring imagination to hear on our UX work. Well worth your time!</p>\n","social_text":"Drop much goodness in this piece! “Imagination is not a splashy poster of a sci-fi movie but a daily act of resistance we must engage in despite how tired we might be.”","url":"https://www.aaron-gustafson.com/notebook/links/how-ux-designers-can-engage-their-imagination/","external_url":"https://www.fastcompany.com/90846822/ux-designers-suffering-from-failure-of-imagination","tags":["user experience","inclusive design"],"image":"https://images.fastcompany.net/image/upload/w_1280,f_auto,q_auto,fl_lossy/wp-cms/uploads/2023/02/p-1-90846822-ux-ethics.jpg","date_published":"2023-02-18T20:11:12Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/netflix-wants-to-chop-down-your-family-tree/","title":"🔗 Netflix wants to chop down your family tree","content_html":"<p>This piece is incredibly disheartening, but it points out the importance of inclusive design.</p>\n","social_text":"This piece is incredibly disheartening, but it points out the importance of inclusive design.","url":"https://www.aaron-gustafson.com/notebook/links/netflix-wants-to-chop-down-your-family-tree/","external_url":"https://pluralistic.net/2023/02/02/nonbinary-families/","tags":["inclusive design"],"image":"https://i0.wp.com/pluralistic.net/wp-content/uploads/2020/02/cropped-guillotine-French-Revolution.jpg?fit=180%2C180&ssl=1","date_published":"2023-02-09T00:41:46Z"},{"id":"https://www.aaron-gustafson.com/notebook/links/digital-exclusion-in-healthcare-how-to-change-it/","title":"🔗 Digital Exclusion in Healthcare &amp;amp; How to Change It","summary":"Fantastic talk from Sareh on assumptions we make about our users and how those assumptions exclude people who have different lived experiences than we do.","content_html":"<p>Fantastic talk from Sareh on assumptions we make about our users and how those assumptions exclude people who have different lived experiences than we do. Her focus is on digital healthcare, but is applicable to everything.</p>\n<p><a href=\"https://www.youtube.com/watch?v=Zi1NXGgsM3s\">https://www.youtube.com/watch?v=Zi1NXGgsM3s</a></p>\n<p>I love her calls to action as well!</p>\n<p>Related talk: <a href=\"https://presentations.aaron-gustafson.com/nqpS67/delivering-critical-information-services\">Delivering Critical Information &amp; Services</a></p>\n","social_text":"Amazing talk from @Sareh88 on assumptions we make about our users and how those assumptions exclude people who have different lived experiences than we do 🥰","url":"https://www.aaron-gustafson.com/notebook/links/digital-exclusion-in-healthcare-how-to-change-it/","external_url":"https://www.youtube.com/watch?v=Zi1NXGgsM3s","tags":["accessibility","empathy","inclusive design","industry","user experience"],"date_published":"2023-01-27T17:17:39Z"}]}