Do Good Things Justice for All
“Do Good Things Justice for All,” an IEEE SIGHT Project – funded by Humanitarian Activities Committee SIGHT Project funding 2019 - 2020, continuing into 2021.
Important reminder: Free Captioning Software available from Google Play, 'Live Transcribe' is very helpful to improve communication when Sign Language interpreters are not available, companions cannot join a person with hearing loss, when hearing aids must be removed, and when masks and or plastic barriers make communication more difficult. Please see the photo collage further down the page for more details.
Celebrating African American History Month.
We will hold a Drop-In Session in February open to anyone. Watch for an announcement and eNotice.
United States Patent and Trademark Office report:
Notable inventors and their patents represented in this report:
• James E. West (U.S. Patent No. 3,118,022 for electret microphone)
• Ellen Ochoa (U.S. Patent No. 4,838,644 for optical systems for performing information processing)
• Marian Rogers Croak (U.S. Patent No. 7,715,368 for text-to-donate technology)
• Rory Cooper (U.S. Patent No. 9,254,234 for robotic strong arm)
• Frances Arnold (U.S. Patent No. 6,153,410 for directed evolution of enzymes)
Thank you to the National Inventors Hall of Fame, NASA, U.S. Department of Veterans Affairs, and Marian Rogers Croak for the use of images on the website. Learn more at www.invent.org, www.nasa.gov, www.herl.pitt.edu, and www.witi.com.
Some IEEE Resources on related History, Publications and News and other items of interest:
January 2021 Continued
Learn about deep learning:
Interesting Wikipedia entry about Sign Language:
With updates in January 2021.
Reminders of Mock Trial Practice information:
Update 20 January 2021:
Michelle Calabro is an inventor who will present her experience and her innovation with us during Women's History Month. Her very exciting and creative game can be found online at:
Updates 19 January 2021:
Amanda Deol of Addteq provides us a link to screen reader products for those with vision loss:
Martin Luther King Jr Day of Service 18 January 2021
We held a Drop-In Session for Martin Luther King Jr Day of Service. An attendee was interested in becoming involved with improving water quality for example dealing with lead in drinking water in Philadelphia. We will be exploring this topic and potential projects.
Lead poisoning Wikipedia:
Lead exposure has been linked to brain changes increasing opioid addiction and risk taking behavior.
Updates 17 January 2021:
Mock Trial case. Notes about other approaches to rights of Children for example, UK:
Updates 9 January 2021:
For more information and to send in your ideas, please email Kit at email@example.com.
For Women's History Month March 2021
It's almost that time again. March, Women's History Month is almost upon us. We had a terrific event in March 2018 together with Stevens Institute of Technology and at their location. Please see the videos on our IEEE NJ Coast Section History Wiki to see the pictures and videos. We launched an effort to promote Celebrating our History: Inventing our Future, and in particular, learning how to promote Inventing among underrepresented, minority, women, and children inventors.
We have made progress since that date, helping people learn facts and statistics about inventing, and more about how to be an Inventor, with a tour at the Edison Museum, efforts with IEEE Milestones, meetings at among other places our favorite Bell Labs historic locations and Maloney's Pub in Matawan. And we have even had some success with our Volunteer efforts to advance Inventions by Women.
Thank you to Graham Alig Patent Agent for all your patient instructions and for your hard work on behalf of one of our newest Inventors, Paula Muller, PhD. Congratulations to Paula for her innovative Sociavi, connecting generations made easy. Congratulations on the success of your joint endeavor. Thank-you, again, Graham.
You can find Paula's patent, U.S. Patent 10,623,696 on the USPTO.gov website.
For this March, we will be planning some events we hope you will all find interesting enough and that you will choose to participate, and perhaps prepare some content. We know many of you are interested in this topic and would like to make a contribution.
Radio Program, Webcast: We will plan episodes of 'The Law & You' for The Honorable Dr Duncan Rogers Lee, II Esquire's radio program which can also be uploaded to our IEEE Section History Wiki, IEEE NJ Coast Section Website and Facebook page, IEEE TV, and our IEEE NJ Coast Section PACE SIGHT Group Blogspot for re-purposing the content. https://www.sites.google.com/site/sensosmartvirtualsensors/do-good-things-justice-for-all
Examples of The Honorable Dr Duncan Rogers Lee, II Esquire's program are at: https://www.wrcr.com/category/podcasts/
Listen to the radio station live: https://radio.securenetsystems.net/v5/index.cfm?stationCallSign=WRCR
Each episode must be one hour long. We will be covering suggested topics important to the Law and also to our various programs including: History of Women Inventors; Promoting Inventing for Underrepresented, Minority, and Women Inventors; Justice and the Americans with Disabilities Act -- Accommodating hearing loss with technology including Captioning; Impact of Disabling Conditions in the American Justice System; How Technology has reduced the number of Missing and Exploited Children; etc.
Please share the plan with others who might be interested.
From Tiffany Lucey's email:
With updates in December 2020.
History of the current project:
We are delighted for the opportunity to create the Pilot for the Experiential Learning Simulation and Training System with Captions (ELSTS). The System will use Virtual Reality, provide measures of the acoustic scenes, and augment meetings with single user Captioning on a display.
ELTS will help people understand how people with hearing loss hear the world and how Captioning can improve speech understanding.
Dave Nall has provided us with an excellent means to experience hearing loss in real time. Our recent meeting and demo is available here:
(If trouble with this link, please email firstname.lastname@example.org.)
We will design and develop the Pilot with close collaboration of the IEEE NJ Coast Section SIGHT Group team members, Stevens Institute of Technology and the Intelligent Network Systems Lab where we will engage engineering students and professors, Stakeholders, SIGHT Group Members, IEEE PACE, perspective Members, etc. to reduce risks. We will test the Pilot in Meetings and (Covid accommodations to be determined) Classrooms at Stevens Institute of Technology, at the Nyack Mock Trial Team (Covid changes - practices and competition have been canceled and courtrooms are now closed). In addition, the team was a finalist in the ‘Do Good Robotics Competition’ at UofM College Park, inspiring the name for our project. We hope to attract more interest, potential funding, etc. We have also attracted support from the SociAvi collaboration for aging community members which has great value and provides reach to individuals in need. This need has expanded dramatically since the advent of Covid 19.
December 2020 -- Update -- Adjusting to COVID-19 includes opportunities to Do Good Things. Please see also updates on IEEE NJ Coast Section History Wiki: https://ethw.org/IEEE_New_Jersey_Coast_Section_History
So much good news. Where to begin?
Today (15 December 2020) we learned that our own team members Dave Nall and Margaret J Lyons, PE have been awarded Honorable Mention SIGHT Volunteer of the Year by the IEEE SIGHT Organization in recognition of their Volunteer Work with SIGHT. Congratulations to Dave and to Margaret. How cool is that! Let's Celebrate with Dave and Margaret. Please see the letters below.
Nyack Mock Trial Team paused for COVID-19 and will now be online. New Case Announced for the Season. We are very grateful to The Honorable Dr Duncan Rogers Lee, II, Esq. for his and the team participation and for the Stakeholder and Community Membership they bring to our project. Watch here for more information and for case documents for the new online season.
We are very grateful to our Stakeholder and Community Member in this project, The Honorable Carolyn Laredo. For more information about the important services she provides through her company, please see also her website: https://lawmediationny.com/
Volunteers have successfully helped Paula Muller, PhD achieve Patents for her technology innovations. Congratulations Paula. Thank you to Graham Alig and all the volunteers involved with Inventing Your Future. Kindly see SociAvi page https://sociavi.com/ and also our volunteer Patent Agent, Graham Alig. https://www.linkedin.com/in/gcalig/ Watch our blog for updates:https://www.sites.google.com/site/sensosmartvirtualsensors/sociavi-keeping-seniors-connected-and-improving-communication
Our team is involved with IEEE Standards including IEEE P2933 for Connected Healthcare, representing the position of people who need Access and Accommodation.
Our team is involved with forming a new IEEE community to develop deliverables looking at a broader level and 'about raising awareness so that accessibility considerations are more broadly incorporated in technology and standards development' and we as a team have learned that scope is possible. Watch here for more information and documentation.
Our contact person at IEEE Headquarters is Moira Patterson. Thank you Moira and the entire team.
Springer Book Chapter on TIPPSS with Florence Hudson near completion.
Florence's first edition is available: Women Securing the Future with TIPPSS for IoT Trust, Identity, Privacy, Protection, Safety, Security for the Internet of Things, Editors: Hudson, Florence (Ed.)
Conference ACM/IEEE CHASE 2020 17 and 18 December 2020 led by team member Yingying Jennifer Chen, PhD.
Letter from IEEE SIGHT to Dave Nall and to Margaret J Lyons, PE:
Sent on behalf of the 2020 SIGHT Steering Committee Chair Sampathkumar Veeraraghavan:
I would like to take this opportunity to recognize the work you have done this year as an IEEE SIGHT volunteer, and inform you that you have been selected as an Honorable Mention of the 2020 SIGHT Volunteer of the Year!
You have been selected due to your contributions to IEEE SIGHT, the New Jersey Coast Section SIGHT Group, and your local community through the "Do Good Things, Justice for All" project. It was easy to see in your nomination files that you have made a positive impact and exhibit steadfast commitment to furthering the IEEE SIGHT mission.
I would like to close by simply saying congratulations! We are extremely thankful to have you as part of the IEEE SIGHT community. Please find your certificate of special recognition attached.
2019 -2020 IEEE SIGHT Steering Committee Chair
Our team Presentation and Springer Book Abstract -- by Katherine Grace August, PhD, Mathini Sellathurai, PhD and Paula Muller, PhD:
June 2020 -- Update -- Summer Mentoring Program Available Through School District Collaboration:
Tiffany Lucey Supervisor of Educational Technology Toms River Regional Schools 1144 Hooper Avenue Suite 210 Toms River, NJ 08753 732-505-5500 ext 7
Tiffany Lucey's Summer Program will offer opportunities for Students to improve their technology skills and for expert Mentoring. Our IEEE PACE SIGHT Group Project provides a perfect opportunity for everyone. We look forward to hearing from the Students and we Engineers and Volunteers will enthusiastically participate in the Summer Project to provide Mentoring to the students.
Please contact Tiffany Lucey at email@example.com
Please contact Kit August at firstname.lastname@example.org
Please contact Tom Willis at email@example.com
Please contact Giovanni Vannucci firstname.lastname@example.org
15 May 2020 -- Update Comment by Dave Nall, Simulation Architect:
Task Progress (experiential hearing loss simulator) :
The phone based conference bridge with the moderator audio profile modification has been implemented. Attendees to the conference bridge can experience the effect of hearing loss while listening to the moderator. The audio profile can be altered while the moderator is speaking to provide different experiences. The conference bridge audio can be recorded for future use.
Observations from the Project:
The project has provided a lot more insight of how broad the impact is when hearing loss is involved in everyday tasks. From simple everyday interactions (stores, offices, meals, and groups) to the needs to interact with government services and the legal system. While I see the result of the ADA in curb cuts and ramps for those with more physical impacts, now that I am looking, I do not see as many results for the benefit of hearing impaired.
The Caption system is expected to improve speech understanding for those who are aging, have moderate hearing loss, students with hearing loss, and others. Not everybody uses Sign Language. Not everybody benefits from hearing aids or FM systems. Captioning can fill in the gaps at a much lower cost. We intend to demonstrate the ease and convenience of Captioning in our pilot. We will measure the cost of the system, time to set up, and flexibility for use. We will conduct surveys of users.
In the image, we have used a free software 'Live Transcribe' from Google Play. We have adapted a waste wearable smartphone carrier with a plastic cover for a hands free configuration. People who may be wearing a mask might be more challenging to hear. Also, the mask obscures facial movements and expressions making Captioning more universally useful to improve communication. In particular, when Sign Language Interpreters cannot accompany a person, or when the hearing aid must be removed, Captioning can become even more important.
An advantage of working with the Nyack Mock Trial Team is that there is no actual plaintiff nor defendant, and therefore, without compromising privacy the work focuses mainly on the environment and logistics within the Court, among real attorneys, judges, and clerks. At present, the courts are closed. However, the need for accommodation in the legal system is as great for witnesses, attorneys, judges, plaintiffs, defendant, and others. And now with Covid 19, many people are wearing masks which reduces the loudness of speaking voices by as much as 10 dB and obscures the mouth of the speaker making speech even more difficult to understand. Captioning can help with speech understanding.
Video of Pizza with Mock Trial Team and IEEE Volunteers: https://youtu.be/DMGTj4YgV0E
Video Example of Mock Trial Team Member at practice: https://youtu.be/IugbFlC1eGQ
Video Example of Mock Trial Competition 1 https://youtu.be/J3DF0ecudHk
We have developed a very good relationship with the Rockland Bar Association which is helping us with access and audience, the Rockland County Clerk’s office (The Honorable Paul Piperato – who has recently passed away 5 May 2020), and many others. Law & Mediation PLLC, Carolyn M. Laredo, Esquire, who consults on cases involving the Americans with Disabilities Act (ADA), provided strong input that resulted in bringing together many concepts inspiring the Experiential Learning Simulation and Training System.
Professor Victor Lawrence, Professor Hong Man, Professor LTC Kennedy-Pegues of US Military Academy West Point, Dr Avi Hauser, Dave Nall, Dr August, Dr Jelinek, Dr Sellathurai, Dr Willis, Dr Vannucci, Dr Wilkus, and many others on the team are investigating hearing loss in the Military which is a complex problem. We are consulting with Professor Skip Rizzo, an expert in Virtual Reality for Veterans and Military personnel. We will develop scenarios for the Experiential Learning Simulation and Training System with Captions to articulate experiences of the Military in the field and following hearing injuries, to help Veterans and others understand the hearing loss they experience, and to improve research and intervention. We will prepare articles to raise awareness and plan additional work for the future.
We are making progress on the Pilot for the Experiential Learning Simulation and Training System with Captions (ELSTS) to improve speech understanding and help people understand how people with hearing loss hear the world. We successfully configured the large screen Captions display and developed the Simulator that alters the voice so listeners can experience how those with hearing loss hear the world. We have taken many recordings at Mock Trial practice and at two Courtroom competitions. Due to Coronavirus and New York on Pause we must alter our Pilot implementations and coordinate with our partners to proceed safely.
The ELSTS will provide Scenarios to help people understand how hearing loss impacts humans in everyday life, it will train people to understand how to improve communication and reduce disparity, and it will Simulate the sensory experience of having a hearing loss. The Captioning will enable display of text of a person’s speech so others can read to improve speech understanding especially in noisy environments.
The Pilot system will be tested and validated by invitation and with Covid 19 considerations. with Stevens Institute of Technology in the lab, classroom and meeting attendees. Picatinny Arsenal, the Military Research group will be invited to review. The Pilot will improve understanding of why and how to comply with the Americans with Disabilities Act. Mediation is a diversion to court providing Justice for those with hearing loss when businesses, schools, organization fail to accommodate. The Simulation and Caption system will be designed and Piloted (with Covid 19 accommodations – with the Nyack Mock Trial a high school team in practice and competition, and or during presentations to Bar Association Members and Stakeholders). We will continue our outreach to learn more about NGOs and others who would benefit. We propose to have a greater impact on helping people to understand Sustainable Development Goals - how low-cost technology can reduce suffering, improve communication, speech understanding, and provide opportunity to reduce disparity – help more with fewer resources. We will reduce risks in execution by simplifying the system design and components using mostly off the shelf highly sustainable low complexity solutions (camera, PC, Oculus, level meter, projector) aiming for downloadable apps and simple configurations. Our Pilot testing is set up so that we have at least three places we can conduct testing, and depending on availability and resources, we can shift order and so forth. We involve Stakeholders on a diverse team supported by Stevens Institute of Technologies experienced Professors, a variety of Volunteers, engaging others who will help capture Stories and Scenarios, and communicating with others working in the same fragmented field with similar goals, including Fraunhofer Research (open source algorithms for hearing aids). We joined IEEE Standards Group P2733 to promote the Humanitarian interests in Standards development, and have engaged in writing a book chapter. We will maintain our network of international colleagues for added support and diversity of skills, understanding needs, and for the benefit of everyone’s experience.
Products on the market already include: expensive hearing aids $2K – 8K, monthly subscription caption system, expensive FM systems for public accommodation costing $18 – 20K per room. Virtual Reality systems are often used for psychotherapy, education, etc. In our ELSTS, we propose a unique combination of technologies: voice processed using acoustic equalizers with virtual reality scenarios so people can put on a headset and have the visual and auditory sensory experience of a hearing loss. The training can then step the individual through scenarios for example, driving a car and suddenly seeing an ambulance when you didn’t hear the siren, a student in a class who can only hear the teacher but not the peers or ambient sound, or trying to hear a bank clerk speaking from behind a glass partition, when all you can hear is the loud noise surrounding you.
Roadmap to Sustainability sharing SDG Goals especially 4, 5, 10, and 16 with examples – low cost, open source, apps, easy to use, networked, mainstream technology, simplified solutions, training, sharing solutions, etc.: Phase I Initial Scenarios Design and Development; Phase II Hardware and Content Development; Web Site Content Development; Phase III Pilot and Feedback; Phase IV Lessons Learnt and Shared.
Timeframe - Fall – Winter 2019: Pilot Experiential Learning Simulation and Training System with Captions 1) Kickoff Meeting – with Training on Sustainable Development Goals especially 4, 5, 10 and 16 and how they fit into the project, 2) Order Equipment, 3) Brainstorming with Students and Stakeholders – reminding of SDGs, disparity, special populations, and outcomes that can be transformative, 4) Configure Hardware and Software, 5) Design and Develop Scenario Storyboards, Content, 6) Plan for Development and Pilot.
Winter – Spring 2020: Demo Captions Create Scenarios 1) Intelligent Network Labs Demo of Captions, 2) Review Scenario Content, 3) Create Scenarios and Web Content for Pilot Simulation and Training System.
Spring 2020: Pilot Tests at Stevens Institute of Technology, Law & Mediation, and Nyack Mock Trial Team (Practice and Competition) 1) Test Pilot at Stevens, 2) Brainstorming with Students – reminding of SDGs, how low cost advancing technology can have a profound impact on humanity – especially in this case, when technology is important for hearing or understanding speech yet it is often too expensive or fails to help, for including women and girls and those with disabling conditions, for providing access to the Justice system, 3) Storytelling activities – Nyack Mock Trial Team and SIGHT Group Members, 4) Pilot Caption System at Mock Trial Practice.
Summer – Fall 2020: Pilot Tests Law & Mediation, Demo with NGOs, SociAvi, etc. 1) Pilot Experiential Learning Simulation and Training Pilot System, 2) Process feedback, 3) Write articles, lessons learnt, 4) Attend conferences, publish, present at meetings, share with other groups.
Fall – Winter 2020: Share design, development, instructions, and lessons learnt in Region 1, with SIGHT, and beyond. Ensure the message of low-cost solutions to a large humanitarian problem can make a greater impact on reducing suffering and disparity than expensive solutions that fail to help. We can use our engineering skills to improve human opportunity even in places with few resources.
The team structure includes: Organizers, who shepherd the project, organize meetings, write, report, etc. and who are the main architects and designers including but not limited to KG August, PhD, A Hauser, PhD, MJ Lyons, PE, D Nall, VB Lawrence, PhD, H Man, PhD, LTC K Kennedy-Pegues, PhD, YJ Chen, PhD, D Devasitharan, PhD, T Willis, III PhD, G Vanucci, PhD, S Wilkus, PhD, and others. International Collaborators engineering who provide input, research resources, feedback, etc. M Sellathurai, PhD, H Jelinek, PhD, AMJ Skolimowski, PhD, D Tulone, PhD, and others. Our Connections to the Justice System include but are not limited to: the Nyack Mock Trial Team, the Honorable Dr DR Lee, II Esquire, Rockland Bar Association, Law & Mediation PLLC, C Laredo, Esquire who has articulated the need for the ELSTS and Captions. We have developed a relationship with Rockland County Clerk’s Office (Honorable Paul Piperato who uses hearing aids) and who will provide access to his offices, and introduce us to management of County and State Courts. We will be able to present our Humanitarian Technology Pilot System ELSTS and Captions and obtain feedback and more information about how to best introduce accommodation systems in the Justice System. We have and will continue to attend Bar and Court functions, and advocate for Humanitarian issues in the Justice System. Beneficiaries include those in Mediation for ADA violations, court employees, attorneys, students, and those with mild to moderate hearing loss, in addition to our Members, Group, Stakeholders, etc.
Update from Dr Paula Muller of Sociavi: May 2020
In these unprecedented times, where communities are in quarantine and visitations are restricted, communication is crucial for aging adults and their families and electronic means are helping to bridge the distance and isolation.
1. Times are tough, but we are tougher... staying connected to families
An update from a recent IEEE NJ Coast Section Celebration when attendees became familiar with the goals of the Do Good Things Justice for All project: https://youtu.be/LPXHTfCrZgM
An update from a recent IEEE NJ Coast Section Proposed IEEE Milestone Neutrodyne approved for placement at Stevens Institute of Technology. This Milestone Celebration would provide an excellent opportunity for demonstration of the Do Good Things Justice for All Pilot Captioning System: https://youtu.be/T0IGuBnEF6I
An update from The Honorable Dr Duncan Rogers Lee, II Esquire:
The Nyack High School Mock Trial team collaboration with Dr. August’s team of IEEE engineers came to an early end this school year due to the SARS-Cov 2 virus. While the engineers were able to take some measurements during practices and during our Intramural trials, the season ended abruptly on March 9th and hence, all further efforts to take courtroom sound measurements this season. The good news was that the Nyack Team was unbeaten at that time.
A local tragedy, the death of Rockland County Clerk, Paul Pipperato, not only was a great personal loss to those of us who knew him, but also the loss of a great advocate for the IEEE efforts to bring access to justice closer for those with hearing loss. Mr. Pipperato, suffering from impaired hearing himself, was an advocate for the IEEE project.
Dr. Duncan Rogers Lee II, Attorney-Advisor, Nyack High School Mock Trial Team.
During the week of May 4, 2020, Jacobs (www.Jacobs.com) highlighted accommodating deaf/hard of hearing team members in the workplace. Jacobs ACE (Access. Connect. Empower.) Network, a community within Jacobs of employees who are dedicated to connecting and empowering those with disabilities or physical or cognitive adaptive challenges, provided PowerPoint slides for a Culture of Caring moment at the start of meetings that week. The slide deck noted some global statistics familiar to NJ Coast SIGHT group: 1-6 people experience hearing loss; 41% of over 50s experience haring loss. The main slide reminded and encouraged people to utilize some basic courtesies at the start of meetings: Speak Slowly & calmly, provide video content with captions and transcripts, get the listeners’ attention before you start to speak, SMILE!
And here’s a picture of me in my WFH office
Be well & keep up the good work! It helps to have purpose and not be adrift in these times.
mjl Margaret J Lyons, PE