First Time Speaking with a Mask at an Event

Presentation team at the event

Over the past couple of months, I have started losing my ability to talk without a mask. One of the effects of a disease, ALS, is that I am losing the ability to breathe without support which also impacts my ability to talk without my ventilator. This past weekend I did my first speaking engagement at Derby City Data Days in Louisville, KY. As the saying goes, “It takes a village.”

As many of you know, I have been producing a video series called Fabric 5 which contains five minutes snippets about various Microsoft Fabric architectural topics. I was going to use some of that content to create a slide deck about medallion architectures in Fabric. As the day got closer, I was concerned I would not be able to maintain the ability to speak during an entire presentation in my condition. My wife and I thought that we could use my videos for the presentation, so we recruited my son, Alex, who does video editing, to put together the videos for the presentation. That only left the intro slides and the ending slides to be covered by me or someone else.

My daughter, Kristyna, was presenting right before me in the same room. She and my wife managed most of the introduction including the sponsor slides and the user groups. I was able to kick off with a microphone that was provided by the venue through Redgate. Then we kicked off the video and took questions during the session. I was able to answer questions with the help of my wife and using the mic provided in the room. We wrapped up with a final Q&A and a couple of references to help people in Fabric.

A quick video from the session

Overall, this was a wonderful experience for all of us and I appreciated the patience of everybody in the room as we worked through this process for the first time. Here are the Fabric 5 videos that were used during the presentation so you can follow up with it later and references are down below from the end of the presentation. I would like to thank the organizers – John Morehouse, Josh Higginbotham, Matt Gordon – once again for the support and the help as I presented masked up for the first time!

Fabric 5 Videos Used in the Presentation

Fabric 5 – Introduction to the Series and OneLake

Fabric 5 – Why Capacity Matters

Fabric 5 – Medallion Lakehouses

Fabric 5 – Medallion in a Lakehouse

Fabric 5 – Medallion Workspaces

Fabric 5 – Medallion with Compute Workspace

Fabric 5 – Centralized Data Lake

Fabric 5 – Dimensions and Master Data

Fabric 5 – Workspace Sources

Fabric 5 – ADF to Bronze

References

Microsoft Fabric Career Hub Page

Data On Wheels YouTube Channel – Fabric 5 Playlist

After Party Fun – Stayin’ Alive

During the after party my ventilator ran out of power and my car charger did not work. This presented a problem because the trip home was over an hour. When we went out to the car, we had a moment of panic because the ventilator ran completely out of power. We went back to the bar where we were at for the after party to plug in, but the charger wouldn’t work. I was without the ventilator for 15 to 20 minutes while they troubleshot the issue. We started to think that they may have to call 911! However, this issue was resolved due to a loose connection. I must thank all of individuals there that helped including John Morehouse who went to get a battery backup system to make sure I could make it home and to my son-in-law who went to our house to bring us our backup battery generator as well to help us get home.

Working with ALS is not always easy and all the help from everyone around me is genuinely appreciated!

Working with ALS – Insights from the Ability Summit

The 14th annual Ability Summit is a global event that I attended a few weeks ago. It is hosted by Microsoft, and it presents the latest technology innovations and best practices for accessibility and inclusion. The event has three main session tracks: Imagine, Build, and Include. Each track examines different aspects of how technology can enable people with disabilities and make the world more inclusive. The event is free, and anyone can register online to attend. All sessions are recorded and can be watched at any time on demand.

Ability Summit 2024 Highlights

As we think about our enduring commitment and goal at Microsoft, which is to build that culture of accessibility and embed it into everything we do, grounded always by the insights of people with disabilities. – Jenny Lay-Flurrie

In the first keynote, Microsoft CEO Satya Nadella and Chief Accessibility Officer Jenny Lay-Flurrie talked about how AI can remove obstacles and create more accessible experiences, while also addressing the challenges and concerns of responsible AI. The keynote showed several examples of how AI can help people with disabilities, such as voice banking for people with ALS, descriptive audio for people with low vision, and Copilot for people with diverse speech patterns. It was very impressive to see Team Gleason featured as a partner with Microsoft to work on AI to help the ALS community preserve their voice.

Team Gleason and Microsoft Team Up to Give an ALS Person His Voice Back

As a platform company, we have to absolutely lean into that and make sure that everything we’re doing, whether it’s Copilot and Copilot Extensibility or the Copilot stack in Azure is all ultimately helping our ISVs, our customers, our partners, all achieve their own goals around innovation, around accessibility. – Satya Nadella

Build Session: Bridging the Disability Divide with AI

The conference had many sessions and keynotes, but this one about the disability divide and AI was very interesting to me. These are three main points I learned from this session: 1) how people with disabilities are benefiting from AI in their personal and professional lives; 2) advice on how to begin and advance the AI journey with accessibility as a priority; 3) the significance of accessibility as a basic value for developing technologies that enable everyone.

This session also provided some resources and opportunities for us to learn more about AI and accessibility, such as the Accessibility Bot, which is a chatbot that can answer questions about Microsoft’s products and services regarding accessibility topics; the AI Studio, which is a platform that allows users to explore and build AI applications using various cognitive services and SDKs; and the AI Platform Team, which is a group of developers and researchers who work on making AI more accessible and inclusive.

In Real Life

I belong to the ALS community (I have ALS), and I rely on a lot of accessible technology both hardware and software to accomplish work. I used a combination of Voice Access in Windows 11, a Stream Deck foot pedal, a foot pedal joystick on my wheelchair and Microsoft 365 Copilot to write this blog post. Voice Access helps me with dictation and specific commands like selecting paragraphs or capitalization. A Stream Deck allows me to do backspace and deletes. A foot pedal joystick acts as a mouse. Copilot assists me with summarizing and rewriting content. As you can tell, we need a whole set of tools to suit our needs, and there is no single tool or method that works for us. I’m excited to see how AI will enhance accessibility for all of us. My goal is to keep sharing the tools and techniques I use to live and work with ALS through my blog and YouTube channel.

October Is National Disability Employment Awareness Month

As many of you know, I was diagnosed with ALS or Lou Gehrig’s disease a couple of years ago. Since then, I have 9 made it a personal mission to write about my continued journey to continue working while the disease progresses. (You can follow my personal story on our Caring Bridge site.) For example, this post will be included in my Working with ALS content that highlights the methods I use to continue working through the various stages of the disease.

Supportive Tools

Tools and Software Presented at Kentucky ALS Resource Meeting

After becoming part of the disabled community, I wanted to learn more about the tools that support accessibility and how I could use those tools to keep working. I am truly thankful to companies like Microsoft who make accessibility a key part of their overall mission with their tools. I am an avid user of Voice Access including using it to write and edit this post. I have also used some of their adaptive tools such as buttons that allow me to do more work with my feet. I share about these tools because I want others to know that having a disability should not prevent you from working.

Supportive Employers

I really must give a shout out 3Cloud who have really supported me in the transition to being disabled in the workforce. I find some irony in the wording that I just used, as I would insist that I am still able to work though I have lost certain physical functionality along the way. It is their belief in my ability to continue to work while doing it differently that has made the transition easier. They continue to work with me to find great ways to work together. Sometimes this includes specific hardware or software to make my job easier. Other times this includes patience during meetings and supporting specific collaboration needs I might have. The support from leadership to my peers has been great.

Working Through Difficulties

It is not always easy to keep working. There are days when I am frustrated because I am unable to work as quickly as I used to work. My mind works faster than my body in most cases. Because I use voice for most of my work from controlling my mouse to typing up documents, what used to be a single click, now takes me multiple commands which can often result in a weird type of context switching.

While the tools are great, they are not perfect. Some tools are downright hard to use because they are 100 percent designed for mouse usage. For example, whiteboarding tools assume you can easily drag and drop and make connections between objects. Many times, this simply cannot be done with the tools that I use. I have relied on others for help when trying to use tools that are difficult to control the voice. Two of the biggest examples for me include Lucid which we use for charting and collaborating with whiteboards. The other example is PowerPoint. PowerPoint assumes you can work within boxes, move them around, and is not very good to use with dictation.

I often need help from family and friends to make these tools work. For me one of the most difficult parts of this is trying to explain what I am thinking in terms easy enough for someone to translate and produce something on the screen. In some cases, this is not that difficult but in brainstorming sessions it is very difficult as a thought poorly formed is not easy to express.

A Hope and a Future

Those of us that have physical limitations can and do continue to work and be productive in the workplace. Employers who support us are highly valued and appreciated. Often what we think in our minds outpaces what we can express with our bodies. As we look at future tools such as CoPilot from Microsoft which use AI to support a variety of tasks in our day-to-day work, there is a lot of promise to make us more productive in the workplace. Thank you to all the companies who support us through tools and employment. Your support is greatly appreciated!

Typing with Your Tongue Part 2: Voice Access

A few months ago, I wrote a post on how I use voice technology to continue working with my ALS condition. Since that post was written, Microsoft released a new voice technology called Voice Access as a part of the Windows 11H2 update. I’m going to talk a little bit about my experience using it. It has changed how I interact with my PC and which tools I choose for voice to text.

Voice Access

You can turn Voice Access on if you’re running the latest version of Windows 11. (Voice Access is not available in Windows 10). You simply go to the Accessibility settings and choose the Voice Access option under Speech. Once you have turned on Voice Access, you will see a bar across the top of your primary screen as shown in the image below. This is how you know you have Voice Access ready to go.

Voice Access is much more than a voice to text tool. Voice Access includes many command tools including a mouse grid option which allows you to grid your screen and select items on the screen using only your voice. Voice Access supports commands such as Open and Close for application windows. You can find out the full list of commands that are available to you in Voice Access here.

How do I use Voice Access?

I typically have Voice Access on all the time except when I’m in meetings. (It will try to type everything that’s said in the meeting, so it needs to be turned off at that time.) There are only two tools where I use Voice Access less often. That would be Outlook and Word. More on that in a bit.

Because Voice Access alternates between dictation and commands, I able to use it when working with most tools. For example, with Windows Mail I will use it to dictate an e-mail, and then click Send to send the same e-mail. When I say “click send”, Voice Access finds the Send button on the window. If there are more than one, it will give me an option to select which Send I meant to click. I find the overall experience pretty good as it allows me to switch between dictation and commands without issue.

I use Voice Access a lot when working with Teams, WhatsApp, and other chat-based tools. Voice Access allows me to have a good voice to text tool in applications that typically do not have great accessibility support. At times, I have used Voice Access instead of Dictation in Office 365, especially when working with PowerPoint and Excel. Neither of these are particularly voice to text friendly and Dictation in PowerPoint is significantly lacking.

Using Office 365 Dictation

I primarily still use Office 365 Dictation when working with Word and with Outlook. Dictation in both tools responds quicker than Voice Access. It also handles some of the issues that are currently being worked on in Voice Access such as punctuation. For example, the bulk of this blog post was authored in Word using Office 365 Dictation because it’s quick, simple, and works well within the context of voice to text.

Other Insights into How I Work with These Tools

Office 365 Dictation is fully online. This means if you lose your internet connection, you lose the ability to use that function. Voice Access on the other hand does not have this dependency and will continue to work without a connection.

The commands between these two tools still vary quite a bit. For example, text formatting is very different between the two tools. In Word, they use “capitalize” to capitalize a word using Dictation. (By the way this has been improved since the last time I wrote my blog post. This improved capability in Office 365 Dictation is huge). In Voice Access you have to say “capitalize that” to capitalize a word or selected words. When you use that same command in Office 365, it will capitalize the whole sentence. This is true of other formatting commands between the two tools.

There are enough variances in those commands to cause frequent issues when working with the two tools interchangeably. I find myself using the wrong command to create a new line or change the case of words regularly. This is something you will have to work through if you go back and forth between the two tools.

I started working with Voice Access while it was still in preview. I am actively working with the Voice Access team and providing feedback about the tool. While many updates have been made, there are still issues with the tool as it continues to mature. If you’ve been working with Windows Speech Recognition and Voice Typing, I would still recommend switching to Voice Access as the experience is much better. Just keep in mind it is still new and you may still run into issues here and there as they continue to improve the product.

When Voice Access became available, I switched immediately to Voice Access as my primary voice command and dictation tool when not using Office 365 (Word and Outlook). I think that this technology will continue to improve and make voice accessibility better for those of us with limited functionality in our hands and arms. As you know from previous conversations, I’m not a huge fan of Dragon because of how it changed my workflow and made things more difficult for me to do in general. Voice Access is a more natural fit into my workflow, and I like it considerably better. I do find myself going back and forth between my roller bar mouse and using a complete voice solution when my hands get tired. That speaks volumes of the work done in Voice Access to help someone like me continue to function by having options in the tools I can use. I look forward to the improvements as they come along.

The Microsoft Ability Summit in Review

abilities summit header

As many of you are aware, I have been dealing with a progressive version of ALS which is affecting my hands and arms and thus my ability to type. Throughout this process I have been writing about the technology that has allowed me to keep working. I really started to dig in and embrace the work that Microsoft is doing in the accessibility space. As I was looking around at what they were doing I stumbled across last year’s Ability Summit. It was interesting because in this Summit they announced the release of some of the Surface accessibility tools as well as Voice Access both of which I will be using a lot of. I have been using Voice Access since it was released in preview in the middle of last year. I plan to write about my experience with Voice Access after the next update of the product which was dropped in preview late February and I hope to have the update soon. My hope is that a number of the issues I’ve been dealing with in the product will be resolved by then.

Picture of Microsoft Adaptive Accessories
Microsoft Adaptive Accessories

Moving on to the Summit. When I came across the Summit in YouTube I was really impressed with the overall approach as well as content and conversations that were part of the event. This year’s Summit took place on March 8th. I took the time to watch much of the conference with my wife to see what new and great things are coming from Microsoft to further enable those of us with disabilities to work in a Microsoft and Windows environment. I was not disappointed! The conference had a number of sessions where they talk about how various individuals are impacting their workplaces as well as reflecting on the life of one of the foremost disability advocates in the country, Judy Heumann.

Along the way, there were a few things that they announced or talked about that excited me. The first of course was that Voice Access was fully released in February. While I haven’t received the update yet I’m looking forward to getting that and reviewing it in a different post. They also showed how Microsoft 365 including the Office tools and Teams have continued to embrace accessibility for people with all types of disabilities. One of the neat things they demonstrated was there’s now an accessibility checker in Word for example that will allow you to see if the formatting you have chosen in your document is accessible or not. I look forward to seeing the continued improvements on this as it brings awareness to those of us who don’t struggle with some of those same issues and shows us how to build documents that are considered fully accessible.

GitHub Next logo
GitHub Next

One of the tools I’m most interested in is Hey GitHub! Beyond even GitHub Copilot, you now have the ability to use voice commands to build code. While this is still in the early stages it is an awesome concept. I of course will be looking at how I could potentially use this to build out some SQL code so I can continue to demo.

There was also a lot of conversation around the impact of AI on our ability to be more productive. This includes the various AI capabilities such as support writing code in Visual Studio and creating summaries of meetings with ChatGPT. I hope to put some of these new findings to good use.

I have been using the public version of ChatGPT to build LinkedIn summaries of blog posts so I don’t have to type them up myself. It has been a cool experience watching the AI build the summary.

If you or your company is looking for insights into how Microsoft as well as other companies are tackling the tough questions around accessibility, I encourage you to check out the various sessions from the Ability Summit. This is a great opportunity to embrace a group of individuals we have a lot to contribute all they need is the opportunity! I want to say a huge thank you to the Microsoft team who have put together this conference and continued to make accessibility a key part of the tools they provide to us.