Re: Sound and Sonification Issues and Inconsistencies
Re: Sound and Sonification Issues and Inconsistencies
- Subject: Re: Sound and Sonification Issues and Inconsistencies
- From: Taliesin Love Smith via Accessibility-dev <email@hidden>
- Date: Fri, 12 May 2023 20:47:06 +0000
- Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=colorado.edu; dmarc=pass action=none header.from=colorado.edu; dkim=pass header.d=colorado.edu; arc=none
- Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=F8LGZmSL/+WWROMG0m2lLk7FUWFIuAxVgp3mMk/gjso=; b=IRaJV0xLcJl0AY3me/FtEU2i0aOfv9qMVrYWWRlBbDYV9EIuWJt0fkwgD8yxBdwOfKBB/LqiMQASMj0RqzmY9xlKhG8ijcW7hA+6Zt0sbHmzXEXSPTeNyFdUvO02eGxPb06HiAs4nOSTyJWkp8TjcVn70jM6B/zMW9GdnXJy9O8T9v597I3mHl4P5sK71+xAJgstm4n8B4+h0WARp1ODYqYfxn3rCPqP4aqaBoKnzy+y/3/l7RsVTzoZpMdb05x90wvh4D7WrSnaF/BAsCbNfpWsPteBBypCE4Dbd7lSMa3OEHyEDebV9myO+tmfyRTXTz+moaYvmEe86GPDawWvpg==
- Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lYm6vysWwhRGpXWQV+ylN+I3OR8BbsIEQaMF+8NP4De9TsPcD7LIvaQRheZ6YeaAGwJxGVPbBpVJj+x53JjWzpIOw/3iJB99FRbbrNme6VF4zwCr2l3zGLPRYmkgmYZYzCem0xDysATETDlrWhHKBrSdx50Za2zqEM3ItqkJI5kzZGqtTCSwPy01fUnN+zFpfO3x88eBDIvI8o7OYB5NT6p9mqXjgs6RLo3Aj6umZnwtxantNJ00Q0ipktnwPnAy/uFYXhGyWHhfjEfoFqet7Ekl4OKwW9luKMoQw4c0/AyHe4pwI6KhsQTYgWlT/MU1nZOFLccP84d6DtnLNALcIQ==
- Thread-topic: Sound and Sonification Issues and Inconsistencies
Dear Apple Devs,
I need to send a followup the email I sent yesterday.
Safari on MacOS is providing sound as expected. It is just on iOS 16 where are
experiencing that sound is prevented when using drag input
We have this noted in a git hub issue
(https://github.com/phetsims/tambo/issues/179).
On MacOS, it is actually the Firefox browser that is behaving similarly, not
Safari.
We are still looking for any work around options Safari’s autoplay behavior on
iOS, and any insights into the issues mentioned in my PS section.
Thanks,
Taliesin
On May 11, 2023, at 5:15 PM, Taliesin Love Smith
<email@hidden<mailto:email@hidden>> wrote:
Dear Apple Devs who care and know about accessibility and inclusion,
Our team at PhET Interactive Simulations designs and implements inclusive
features<https://phet.colorado.edu/en/simulations/filter?type=html,prototype&a11yFeatures=accessibility>
for highly interactive learning tools.
We find that the changing policies at Apple are having general adverse effects
on the inclusive experiences we carefully design for learners who use our HTML5
simulations. When learners use the simulations with Apple products like Safari,
Safari + VoiceOver, or Safari + iOS VoiceOver, they can can run into trouble.
The most recent issue is that sound no longer plays when a learner moves a
slider or movable object in a simulation. The learner must first press a button
in the simulation. How is a sonified slider, or moving object any different
from a sonified button? All are interactive elements and all make sounds. A
learner is choosing to interact, and we feel they should be getting the full
experience of the interaction. Learners have a clear option to turn off the
sounds if they do not want to hear them.
In addition, this latest change to how Safari handles sounds makes for a very
inconsistent user experience in many contexts. At first the slider or moving
object won’t make sounds, but then they will make sounds after pressing a
button. This is not good design, nor is it inclusive design.
Is there a work around for this issue? We want all our sounds to work when
interacting as we have designed them to work.
Sincerely,
Taliesin Smith
PS
I have a few other issues. I invite you to try them out:
* With iOS VoiceOver - some toggle buttons no longer work. This is a
serious problem in Molecules and
Light<https://bayes.colorado.edu/dev/html/molecules-and-light/1.5.21/phet/molecules-and-light_en_phet.html>.
I cannot turn the Light Source to an on position. Blind learners cannot use
their phones or iPads to access this sim. The sim works fine with MacOS
VoiceOver.
* With iOS VoiceOver custom grab and drag interactions were also broken,
but I just checked again and these custom drag interactions look like they may
be working again, see Balloons and Static
Electricity<https://phet.colorado.edu/sims/html/balloons-and-static-electricity/latest/balloons-and-static-electricity_all.html>
and
Friction<https://phet.colorado.edu/sims/html/friction/latest/friction_all.html>.
Thanks for fixing this. They weren’t working for a very long time. I last
checked in January 2023. I’ll request these sims be republished with this
important feature. This means they have to go through our quality assurance
process again which takes up valuable resources for a non-profit.
* With MacOS VoiceOver, an annoying sound plays when I activate a custom
interaction like the Yellow Balloon in Balloons and Static
Electricity<https://phet.colorado.edu/sims/html/balloons-and-static-electricity/latest/balloons-and-static-electricity_all.html>.
Is there a way to turn the sound off? We have our own sonifications.
Again sincerely,
Taliesin Smith
~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~.~
Taliesin L. Smith
email@hidden<mailto:email@hidden>
Inclusive Design Research Specialist
PhET Interactive Simulations
http://phet.colorado.edu/
Department of Physics
University of Colorado, Boulder
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Accessibility-dev mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden