• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

Classroom Teacher

Exploring Dragon Naturally Speaking and Classroom Technology

  • Dragon Naturally Speaking Reviews ▼
    • Nuance Dragon Home vs Professional 15 review
    • Nuance Dragon NaturallySpeaking 13 Premium Review
  • Classroom Tech Ideas
    • Show 2 different screens:
      laptop vs projector / TV
    • Add arrows and notes onto a screenshot
  • 21st Century Learning Skills ▼
    • 6 Cs of Education
    • Goal Setting for Students:
      powerpoint, lesson, worksheet
  • About this site
    • Disclosure Policy
    • Privacy Policy

Is Dragon NaturallySpeaking 12 really more accurate than Dragon NaturallySpeaking 11?

August 3, 2012 - 2 Comments

Dragon Naturally Speaking premium 12 just came out today, and the official nuance website says the updated speech recognition software is more accurate, straight out-of-the-box compared to Dragon 11. (Apparently, it’s up to a 20% more accurate than Dragon Naturally Speaking 11.) Maybe, but I’m not so sure.

After using Dragon Naturally Speaking (11.5) for 60 blog posts and 74,000+ words, I find the voice recognition engine generally gets around 97.6% of the words correct.

I used the rainbow passage to do a quick check to see if Dragon Naturally Speaking 12 was really better than Dragon Naturally Speaking 11. The cool thing about Dragon Naturally Speaking premium is that you can transcribe recordings from MP3 files. (Only your own voice, sorry!)

  • I recorded the rainbow passage as an MP3 and included punctuation and commands (i.e. “comma”, “period”, and “new paragraph”) “Recording #1”
  • I used audacity to trim out the punctuation and commands and I saved this as “Recording #2.”

This way I could be sure that any differences between Dragon 12 and Dragon 11 would be due to the voice-recognition software and not differences in the way that I read the rainbow passage.

I also used two different user profiles to compare Dragon Naturally Speaking 11 and Dragon Naturally Speaking 12.

  • I created a brand-new user profile in both Dragon Naturally Speaking 11, and Dragon Naturally Speaking 12. I went to the general training process, but I did not let Dragon analyze my emails and documents when I created these profiles.
  • I used my regular Dragon Naturally Speaking user profile that I’ve been training for almost two years. (I’ve used this voice profile to dictate more than 74,000 words with an average accuracy of 97.6%.) I also upgraded this user profile for Dragon Naturally Speaking 12 when I was testing it.

Finally, I saved each transcription into a plain text file and then I used tortoise merge to compare the original document to what Dragon Naturally Speaking transcribed. Usually, I go through and look at the type of mistakes Dragon Naturally Speaking made to separate word errors from punctuation and capitalization errors, but this time I kept things simple. (Check out the results at the bottom of this post.)

  • Red errors are incorrect words, or additional words that Dragon Naturally Speaking wrote down.
  • Green lines are words or punctuation that Dragon Naturally Speaking missed.

Overall, Dragon Naturally Speaking 12 seems less accurate than Dragon Naturally Speaking 11 for both new user and trained voice profiles. Here are the results:

Dragon Naturally Speaking 12 vs Dragon Naturally Speaking 11 Accuracy

The new version of Dragon Naturally Speaking (12) made more mistakes, even straight out-of-the-box (test #1 and test #2.) In fact, when I analyzed my MP3 of the rainbow passage with commands (test #1), Dragon NaturallySpeaking 12 made almost twice as many mistakes as Dragon NaturallySpeaking 11.

It’s also interesting to note that my trained user voice profile makes fewer mistakes than a brand-new profile. I guess Dragon really does improve over time!

  • When I used my regular profile and the rainbow passage with commands (test #3), Dragon Naturally Speaking made slightly fewer mistakes (5 or 10 mistakes) compared to a brand-new profile (8 or 15 errors.)
  • If you check out the rainbow passage with no commands (test #4), my regular user profile made less than half the mistakes (23 or 26 mistakes) that a brand-new profile heard with the same recording (60 or 65 mistakes).

Brand-new user profile

Test #1 using Rainbow Passage With Commands (i.e. “comma”, “period”, “new paragraph”) – Recording #1

Dragon Naturally SpeakingRed ErrorsGreen Errors / LinesTotal Number of Errors
DNS 11718
DNS 1213215

Test #2 using Rainbow Passage With NO Commands – Recording #2

Dragon Naturally Speaking VersionRed ErrorsGreen Errors / LinesTotal Number of Errors
DNS 11273360
DNS 12323365

User Profile after 74,000 words with a general word recognition accuracy around 97.6%

Test #3 using Rainbow Passage With Commands (i.e. “comma”, “period”, “new paragraph”) – Recording #1

Dragon Naturally SpeakingRed ErrorsGreen Errors / LinesTotal Number of Errors
DNS 11415
DNS 127310

Test #4 using Rainbow Passage With NO Commands – Recording #2

Dragon Naturally Speaking VersionRed ErrorsGreen Errors / LinesTotal Number of Errors
DNS 11121123
DNS 12151126

A few general comments:

The point of this post is to quickly compare the latest version of Dragon Naturally Speaking to see how good it is. As a previous reader pointed out, some errors that I count are not actually errors:

  • For example, “Norse men” and “Norsemen” and “super position” and “superposition” are not actually errors, but variations of the same word.
  • sun’s and sun‘s is also not an error – it’s just the difference between a curly apostrophe and a straight apostrophe.

But given that I used the same recording of the rainbow passage in this study, we can still get a sense of the relative strengths of the voice-recognition software. Dragon Naturally Speaking is still hands-down, the best voice recognition software I’ve played with. I look forward to working with Dragon Naturally Speaking 12 over the next few weeks to see how it improves.

Did you upgrade to Dragon Naturally Speaking 12? How do you like it?

This blog post was dictated using Dragon NaturallySpeaking Premium 12 and Microsoft Word.

  • There were 678 words in the first draft of this post. This doesn’t include any of the tables or the stuff below this line.
  • Dragon Naturally Speaking 12 made 23 word errors which mean that it transcribed 96.6% of the words correctly.
  • The voice recognition software also made an additional 15 punctuation and capitalization errors meaning the total accuracy rate was 94.4%.

Click here to find out more about the Dragon NaturallySpeaking Student / Teacher version.


RAINBOW PASSAGE WITH COMMANDS

DNS 11, brand new DNS profile

  • 7 red errors
  • 1 green errors (lines)

DNS 11, DNS profile after 74,000 words

  • 4 red errors
  • 1 green errors (lines)

DNS 12, brand new DNS profile

  • 13 red errors
  • 2 green errors (lines)

DNS 12, DNS profile (updated to DNS 12) after 74,000

  • 7 red errors
  • 3 green errors (lines)

Rainbow Passage – no commands

DNS 11 – Brand new profile

  • 27 red errors
  • 33 green errors (lines)

DNS 11 – DNS profile after 74,000 words

  • 12 red errors
  • 11 green errors (lines)

DNS 12 – Brand new DNS profile

  • 32 red errors
  • 33 green errors (lines)

DNS 12 – DNS updated profile after 74,000 words

  • 15 red errors
  • 11 green errors (lines)


Dragon Naturally Speaking Home vs Professional 15 Review:

  • Nuance offers two versions of their voice software. Read this blog post comparing Dragon Professional vs Dragon Home 15.
  • UPDATE (Tue, Dec 10, 2019): By the way, I still use Dragon Professional 15 to blog and write things down – even though I type at 100+ WPM. The last post I dictated was this one about a free New Year’s Resolution writing activity.

Reader Interactions

Comments

  1. David L says

    September 24, 2012 at 5:26 pm

    It would be very interesting to me to see how “Dragon Dictate”, their Mac product, handled your cases. I have found that Dictate is much less smooth to use, and so have been running Naturally Speaking in Parallels. But that has a high cost to keep working, to switch back and forth from, and in load on my computer. As a result, I tend to use neither — the activation cost is too high.

    Thanks for a nice comparison!

    Reply
    • Kuroneko says

      September 27, 2012 at 11:17 pm

      Hey Dave – thanks for the feedback. I find the iPad is hooking me into the Apple universe to the point that I’m considering getting a Mac. I haven’t heard much about Dragon Dictate’s accuracy and I always had it in the back of my mind that I could always use Parallels to get my copy of Dragon NaturallySpeaking to work if I didn’t like Dragon Dictate… One question for you – does the Bluetooth Plantronics Calisto headset work when you’re running Dragon Naturally Speaking in Parallels? I wasn’t sure, and now that I’m having problems with the new version of the Calisto headset to work properly with Dragon 12, I’m a little nervous to switch over to Mac… It’s a pricey set up and I find having a powerful computer makes a huge difference in the voice recognition accuracy.

      Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Primary Sidebar

I use Dragon Professional 15 (OFFICIAL WEBSITE) to write documents and dictate blog posts.

  • Comparing Nuance Dragon Home vs Professional 15
  • Nuance Dragon NaturallySpeaking 13 Premium vs Professional 15 review: A story about helping a friend using voice recognition software for the first time.
  • 10 things to know about Dragon Naturally Speaking Education Version BEFORE you buy

Things people google:

  • how to reveal words behind marks on screenshot
  • split screen on projector
  • how do i circle text in emails screen shots
  • dragon naturally speaking home vs professional version
  • how to edit sceenshot add arrows etc
  • does nuance dragon read?
  • How to see one document on a laptop and another document on a screen
  • how to show something on screen and work on your computer at the same time
  • draw and screenshot
  • how to project video throu hdmi in diftent tabs
  • dragon home versus professional
  • using arrows in snipping tool
  • dragon 11 vs 15
  • difference between dragon naturally speaking recording system and dragon speech recognition software
  • how to make your monitor and computor show the same thing
  • Add arrows with snipping tool
  • Google Classroom chat box
  • power point class for how to move from one point to another dismounted
  • snipping tool arrows
  • can children privately message eachother on google classroom?
Use Dragon Speak Naturally: Side by side comparison of Nuance Dragon Home 15 vs Nuance Dragon Professional 15 showing multiple user profile option in start window

Dragon Naturally Speaking Review: Dragon Home 15 vs Dragon Professional Individual 15 (NEWEST VERSION)

Classroom Technology

Picture of a Windows laptop screen showing one thing and the projector screen showing a different screen

How to project computer to TV and show different display on laptop / projector / TV

How to Draw on a Screenshot: Quickly Add Arrows and Text on a Screenshot (Windows)

screenshot of iPad showing general and accessibility options to lock ipad to one app

How to lock your iPad screen so students can only use 1 specific app

Recent Comments

  • Grade 8 Teacher on Dragon Naturally Speaking Review: Dragon Home 15 vs Dragon Professional Individual 15 (NEWEST VERSION)
  • Rob on Dragon Naturally Speaking Review: Dragon Home 15 vs Dragon Professional Individual 15 (NEWEST VERSION)
  • Grade 8 Teacher on Dragon Naturally Speaking Review: Dragon Home 15 vs Dragon Professional Individual 15 (NEWEST VERSION)
  • Leslie Lundberg on Dragon Naturally Speaking Review: Dragon Home 15 vs Dragon Professional Individual 15 (NEWEST VERSION)
  • Grade 8 Teacher on Dragon NaturallySpeaking Versus iPad Dictation – Which One Is Better?

Copyright © 2021 · ClassroomTeacher.ca uses Dragon Naturally Speaking · Log in