Best printers for Home

Best Mixer Grinder

Best wired Earphones

Best 43 Inch TV in India

Best Wi Fi Routers

Best Home Theatre in India

Smart Watch under 5000

Best Laptops for Education

Best Laptop for Students

<ul class="summary-list"><li>A digital mental health company is drawing ire for using GPT-3 technology without informing users. </li><li>Koko co-founder Robert Morris told Insider the experiment is "exempt" from informed consent law due to the nature of the test. </li></ul><a href="https://www.businessinsider.com/chatgpt-vc-funding-generative-ai-startup-market-2023-1">As ChatGPT's use cases expand</a>, one company is using the artificial intelligence to experiment with digital mental health care, shedding light on ethical gray areas around the use of the technology. Rob Morris — co-founder of Koko, a free mental health service and nonprofit that partners with online communities to find and treat at-risk individuals — wrote in a <a href="https://twitter.com/RobertRMorris/status/1611450197707464706?s=20&amp;t=3zcc67ED1Zgk9FJqRZnNAg" target="_blank" rel="noopener">Twitter thread</a> on Friday that his company used GPT-3 chatbots to help develop responses to 4,000 users.Morris said in the thread that the company tested a "co-pilot approach with humans supervising the AI as needed" in messages sent via Koko peer support, a platform he described in an accompanying <a href="https://www.loom.com/share/d9b5a26c644640ba95bb413147e41766" target="_blank" rel="noopener">video</a> as "a place where you can get help from our network or help someone else.""We make it very easy to help other people and with GPT-3 we're making it even easier to be more efficient and effective as a help provider," Morris said in the video.ChatGPT is a variant of GPT-3, which creates human-like text based on prompts, both created by OpenAI.Koko users were not initially informed the responses were developed by a bot, and "once people learned the messages were co-created by a machine, it didn't work," Morris wrote on Friday. "Simulated empathy feels weird, empty. Machines don't have lived, human experience so when they say 'that sounds hard' or 'I understand', it sounds inauthentic," Morris wrote in the thread. "A chatbot response that's generated in 3 seconds, no matter how elegant, feels cheap somehow."However, on Saturday, <a href="https://twitter.com/RobertRMorris/status/1611775514590740480" target="_blank" rel="noopener">Morris tweeted</a> "some important clarification.""We were not pairing people up to chat with GPT-3, without their knowledge. (in retrospect, I could have worded my first tweet to better reflect this)," the tweet said."This feature was opt-in. Everyone knew about the feature when it was live for a few days."Morris said Friday that Koko "pulled this from our platform pretty quickly." He noted that AI-based messages were "rated significantly higher than those written by humans on their own," and that response times decreased by 50% thanks to the technology. <h2>Ethical and legal concerns </h2>The experiment led to outcry on Twitter, with some public health and tech professionals calling out the company on claims it violated <a href="https://www.hhs.gov/ohrp/regulations-and-policy/guidance/faq/informed-consent/index.html"></a><a href="https://www.hhs.gov/ohrp/regulations-and-policy/guidance/faq/informed-consent/index.html">informed consent law</a>, a federal policy which mandates that human subjects provide consent before involvement in research purposes. "This is profoundly unethical," media strategist and author Eric Seufert <a href="https://twitter.com/eric_seufert/status/1611730988295651329" target="_blank" rel="noopener">tweeted on Saturday</a>. "Wow I would not admit this publicly," Christian Hesketh, who describes himself on Twitter as a clinical scientist, <a href="https://twitter.com/jc_hesketh/status/1611580466997653504" target="_blank" rel="noopener">tweeted Friday</a>. "The participants should have given informed consent and this should have passed through an IRB [institutional review board]."In a statement to Insider on Saturday, Morris said the company was "not pairing people up to chat with GPT-3" and said the option to use the technology was removed after realizing it "felt like an inauthentic experience." "Rather, we were offering our peer supporters the opportunity to use GPT-3 to help them compose better responses," he said. "They were getting suggestions to help them write more supportive responses more quickly."Morris told Insider that Koko's study is "exempt" from informed consent law, and cited <a href="https://jmir.org/2018/6/e10148/">previous published research</a> by the company that was also exempt. "Every individual has to provide consent to use the service," Morris said. "If this were a university study (which it's not, it was just a product feature explored), this would fall under an 'exempt' category of research."He continued: "This imposed no further risk to users, no deception, and we don't collect any personally identifiable information or personal health information (no email, phone number, ip, username, etc)."<div type="image" title="A woman sits on a couch with her phone" height="1333" width="1778" msid="96821726" hostid="261" sizebytes="43022"></div><h2>ChatGPT and the mental health gray area</h2>Still, the experiment is raising questions about ethics and the gray areas surrounding the use of AI chatbots in healthcare overall, after already prompting <a href="https://www.businessinsider.com/nyc-schools-ban-chatgpt-cheating-concern-grows-2023-1">unrest in academia</a>.Arthur Caplan, professor of bioethics at New York University's Grossman School of Medicine, wrote in an email to Insider that using AI technology without informing users is "grossly unethical." "The ChatGPT intervention is not standard of care," Caplan told Insider. "No psychiatric or psychological group has verified its efficacy or laid out potential risks."He added that people with mental illness "require special sensitivity in any experiment," including "close review by a research ethics committee or institutional review board prior to, during, and after the intervention" Caplan said use of GPT-3 technology in such ways could impact its future in the healthcare industry more broadly. "ChatGPT may have a future as do many AI programs such as robotic surgery," he said. "But what happened here can only delay and complicate that future." Morris told Insider his intention was to "emphasize the importance of the human in the human-AI discussion." "I hope that doesn't get lost here," he said.

Online mental health company uses ChatGPT to help respond to users in experiment — raising ethical concerns around healthcare and AI technology

<ul class="summary-list"><li>ChatGPT has already passed the US Medical Licensing Exam, the test all doctors must take.</li><li>Now radiologists say it can also pass their specialist board exam.</li></ul>ChatGPT is becoming a great medical test taker.Its latest and most advanced version, ChatGPT-4, can already pass the <a href="https://www.insider.com/chatgpt-passes-medical-exam-diagnoses-rare-condition-2023-4#:~:text=US%20medical%20exam%20licensing%20questions%20correctly%20more%20than%2090%25%20of%20the%20time.">US Medical Licensing Exam</a> with flying colors. And now, it's moved one step closer to becoming a specialized physician. Well, sort of. On Tuesday, <a href="https://www.eurekalert.org/news-releases/988870?" target="_blank" rel="noopener">scientists announced</a> that the newest chatbot software from OpenAI can handily pass a Canadian or US-style radiology board exam – scoring more than ten points above the 70% passing threshold. But there's a catch: Because ChatGPT is only designed to process language (so far), the AI's radiology exam didn't include any images. Feels like kind of a major oversight for a branch of medicine concerned with diagnosing based on X-rays, MRIs, and other body pictures.<h2>ChatGPT did well on 'challenging' questions, but got some of the basics of radiology wrong</h2><div type="image" title="ct scan" height="1335" width="2000" msid="100286779" hostid="261" sizebytes="144744"></div>ChatGPT has shown itself to be <a href="https://www.businessinsider.com/list-here-are-the-exams-chatgpt-has-passed-so-far-2023-1#sommelier-examinations-8">a formidable test taker</a> — it's passed exams including the SAT, the bar exam, and even the challenging master sommelier tests. On the radiology exam, ChatGPT-4 delivered a passing score of 81%. The bot scored particularly well on higher-order thinking questions that require skills beyond just memory recall, like analysis, synthesis, and evaluation; ChatGPT-4 did well at describing imaging findings (85%), and applying concepts (90%). But it didn't do so great on some of the more straightforward questions on the test, and actually got 12 of those questions wrong that its predecessor, GPT 3.5, got right."We were initially surprised by ChatGPT's accurate and confident answers to some challenging radiology questions," study author Dr. Rajesh Bhayana, an abdominal radiologist at Toronto General Hospital, said in a <a href="https://www.eurekalert.org/news-releases/988870?" target="_blank" rel="noopener">press release</a>. "But then equally surprised by some very illogical and inaccurate assertions."<h2>Why ChatGPT is increasingly good at acing hard tests </h2>At its core, ChatGPT is simply designed to predict the best next word to spit out – in other words, it's <a href="https://www.businessinsider.com/everything-you-need-to-know-about-chat-gpt-2023-1#:~:text=Chat%20bots%20like%20GPT%20are%20powered%20by%20large%20amounts%20of%20data%20and%20computing%20techniques%20to%20make%20predictions%20to%20string%20words%20together%20in%20a%20meaningful%20way.">built to chat</a> you up. That chattiness can easily be harnessed to pontificate on exams, producing a very confident (but sometimes wrong) test taker. Brown computer science professor Ellie Pavlick, a natural language processing expert, says this issue isn't unique to chatbots. She's always struggled to tell whether students really grasp the concepts she's taught based on their written exam answers. "If you give some well-constructed language, it seems like you know, but maybe you do, maybe you don't," Pavlick said during a recent <a href="https://youtu.be/zVQVjljd3QA?t=3024" target="_blank" rel="noopener">ChatGPT roundtable at Brown University</a>. "This is a nice indication of why we kind of want to attribute much more knowledge and awareness to ChatGPT than it actually really has, because there's just something about well-constructed language that can really mask [poor] understanding."Doctors say that ChatGPT shouldn't be used to diagnose or treat patients, and should always have its medical accuracy checked by a person. But medical experts are also discovering how ChatGPT can be a nice tool for <a href="https://www.businessinsider.com/chatgpt-more-empathetic-than-doctors-study-save-time-bedside-manner-2023-5">improving a doctor's communication with their patients</a>. It is precisely because ChatGPT excels at banter that it is often regarded as more compassionate than hurried doctors.

After passing another medical exam, ChatGPT is moving one step closer to ChatMD

Is it a handy tool — or a ticking time bomb?When Sam Altman was sunsetting his first startup in early 2012, there was little indication that his path ahead would parallel that of Silicon Valley's then-wunderkind Mark Zuckerberg.While Altman was weighing his next moves after shutting down Loopt, his location-sharing startup, the Facebook CEO was at the forefront of social media's global takeover and leading his <a href="https://www.businessinsider.com/exclusive-heres-the-inside-story-of-what-happened-on-the-facebook-ipo-2012-5">company to a blockbuster initial public offering</a> that valued Zuckerberg's brainchild <a href="https://www.businessinsider.com/still-confused-by-the-facebook-ipo-heres-a-complete-qa-2012-5">at $104 billion</a>. But just over a decade later, the tables have dramatically turned. Nowadays, the promise of social media as a unifying force for good has all but collapsed, and <a href="https://www.businessinsider.com/meta-layoffs-second-round-next-week-2023-3">Zuckerberg is slashing thousands of jobs</a> after his company's <a href="https://www.businessinsider.com/facebook-meta-stock-price-market-colllapse-mark-zuckerberg-metaverse-mistake-2022-2">rocky pivot to the metaverse</a>. And it's Altman, <a href="https://www.businessinsider.com/sam-altman-chatgpt-openai-ceo-career-net-worth-ycombinator-prepper-2023-1">a 37-year-old Stanford dropout</a>, who's now seeing his star rise to dizzying heights — and who faces the pitfalls of great power.Altman and his company Open AI have put Silicon Valley on notice <a href="https://www.businessinsider.com/everything-you-need-to-know-about-chat-gpt-2023-1">since releasing ChatGPT</a> to the <a href="https://www.businessinsider.com/chatgpt-ai-chaos-openia-google-creatives-academics-2023-1#:~:text=via%20Getty%20Images-,An%20updated%20version%20of%20OpenAI's%20chatbot%2C%20ChatGPT%2C%20launched%20on%20November,creative%20ways%20to%20use%20it.">public in November</a>. The artificial-intelligence model, which can write prose, code, and much more, is perhaps the most powerful — and unpredictable — technology of his generation. It has also been a gold mine for Altman, leading to a <a href="https://www.businessinsider.com/microsoft-investing-billions-into-chatgpt-creator-openai-partnership-2023-1">multiyear, multibillion-dollar deal</a> from Microsoft and the onboarding of 100 million users in its first two months. The pace of growth far exceeds TikTok's and Instagram's march to that milestone, making it the <a href="https://www.businessinsider.com/chatgpt-may-be-fastest-growing-app-in-history-ubs-study-2023-2">fastest-growing consumer internet application</a> in history.Much like social media in 2012, the AI industry is standing on the precipice of immense change. And while social media went on to reshape our world over the next 10 years, experts told me that the consequences of AI's next steps would be an order of magnitude larger. According to researchers, the current AI models are barely scratching the surface of the tech's potential. And as Altman and his cohort charge ahead, AI could fundamentally reshape our economy and lives even more than social media. "AI has the potential to be a transformative technology in the same way that the internet was, the television, radio, the Gutenberg press," professor Michael Wooldridge, the director of foundational AI research at the Turing Institute, said. "But the way it's going to be used, I think, we can only really scarcely imagine."As Zuckerberg's track record at Facebook has proved, technology let loose <a href="https://www.businessinsider.com/mark-zuckerberg-whats-good-for-world-not-necessarily-facebook-2018-12">can have profound consequences</a> — and if AI is left unchecked or if growth is prioritized over safety, the repercussions could be irreparable.<h2>Revolutionary tech, done dangerously</h2>Dan J. Wang, now an associate professor of business and sociology at Columbia Business School, used to drive past Altman's Loopt office in Palo Alto, California, as a Stanford undergrad. He told me that he saw a lot of parallels between Altman and Zuckerberg: The pair are "technology evangelists" and "really compelling leaders" who can gain the faith of those around them. Neither man was the first person to strike out in their respective fields. In Facebook's case, rivals like Myspace and Friendster had a head start, while AI has been in development for decades. But what they lack in originality, they make up for in risk tolerance. Both Zuckerberg and Altman have a willingness to expand the public use of new technology at a far faster pace than their more cautious predecessors, Wang said. "The other thing that is really interesting about both of these leaders is that they're really good at making technologies accessible," he told me.But the line between releasing cutting-edge tech to make people's lives better and letting an untested product loose on an unsuspecting public can be a thin one. And Zuckerberg's track record provides plenty of examples of how it can go wrong. In the years since Facebook's 2012 IPO, the company has rolled out dozens of products to the public, while profoundly influencing the offline world. The <a href="https://www.businessinsider.com/cambridge-analytica-whistleblower-christopher-wylie-facebook-data-2019-10">Cambridge Analytica scandal</a> exposed the privacy problems that come with collecting the personal data of billions of people; the use of Facebook to facilitate violence like <a href="https://www.nytimes.com/2018/10/15/technology/myanmar-facebook-genocide.html" target="_blank" rel="noopener">the genocide in Myanmar</a> and the Capitol Hill insurrection showed just how toxic misinformation on social platforms could be; and the harms of services<a href="https://www.businessinsider.com/facebook-internal-report-shows-instagram-bad-for-teens-2021-9"> like Instagram on mental health</a> have posed uncomfortable questions about the role of social media in our everyday lives.Facebook's damaged reputation is the result of the company racing ahead of consumers, regulators, and investors who failed to understand the consequences of billions of people interacting online at a scale and speed unlike anything before it. Facebook and Zuckerberg have apologized for their mistakes — but not for the guns-blazing approach of its evangelist leader who has come to embody tech's "move fast and break things" mantra. If social media helped expose the worst impulses of humanity on a mass scale, generative AI could be a turbocharger that accelerates the spread of our faults."The fact that generative-AI technology has been put out without a lot of due diligence or without a lot of mechanisms for consent — this kind of thing is really aligned with that 'move fast and break things' mindset," Margaret Mitchell, an AI research scientist who cofounded the AI-ethics division at Google, said.For Heidy Khlaaf, the director at the cybersecurity and -safety firm Trail of Bits and a former systems-safety engineer at OpenAI, the current hype cycle around generative AI that prioritizes commercial value over societal impact is, in part, being driven by companies making exaggerated claims about the technology for their own benefit."Everyone is trying to deploy this and implement it without understanding the risks that a lot of really amazing researchers have been looking into for at least the past five years," she said. "Your new technology should not be going out to the world if it can cause these downstream harms."This should offer a stark warning to Altman, OpenAI, and the rest of the artificial-intelligence industry, Mitchell told me. "Once implemented in systems that people are relying on for either facts or life-critical decisions, it's not just a novelty," she said.<h2>OpenAI opens Pandora's box </h2>While the underlying tech that powers AI has been around for a while, the power balance between ethics and profitability in the industry is starting to shift in a different direction. After securing a multibillion-dollar investment from Microsoft in January, OpenAI is now rumored to be valued at $30 billion and has wasted no time in commercializing its technology. <a href="https://www.businessinsider.com/new-microsoft-bing-openai-more-powerful-chatgpt-2023-2">Microsoft announced the integration of OpenAI's technology</a> into its search engine Bing on February 7 and said it planned to infuse AI into other Microsoft products.The move has sparked something of an AI <a href="https://www.businessinsider.com/ai-email-inbox-revolution-chatgpt-google-openai-shortwave-productivity-tools-2023-3">arms race</a>. Google, which for a long time was Silicon Valley's dominant force on AI, has picked up the pace with its own commercialization efforts. The tech giant released a <a href="https://www.businessinsider.com/ai-chatbots-chatgpt-google-bard-microsoft-bing-break-internet-search-2023-2">ChatGPT competitor called Bard</a> just 68 days after the Bing announcement. But Bard's release also served as a cautionary tale for scaling too quickly: The launch announcement was riddled with errors, and Google's stock tumbled as a result. And it's not as if Bard is the only AI tool with problems. In its short life, ChatGPT has shown that it is prone to "<a href="https://www.businessinsider.com/ai-chatbot-chatgpt-google-microsofty-lying-search-belief-2023-2">hallucinations</a>" — confident responses that appear true but are false. Biases and inaccuracies have been common occurrences, too.This approach of throwing caution to the wind is unsurprising to experts: Mitchell told me that while many companies would have been too scared to be the first mover, given the attention it would have brought upon them, OpenAI's highly public projects have made it much easier for everyone else to follow. "It's kind of like when you're on the freeway and everyone is speeding, and you're like, 'Well, look at those other guys. They're speeding. I can do that, too,'" she said.Experts say that Bing, Bard, and other AI models should generally work out the technological kinks as they evolve. The real danger, they told me, is the human oversight of it all. "There's a technological challenge where I'm more confident that AI will get better over time, but then there is the governance challenge of how humans will govern AI — there, I'm a bit more skeptical that we're on a good path," Johann Laux, a postdoctoral fellow at the Oxford Internet Institute, said.The Turing Institute's Wooldridge reckons pernicious issues like fake news could see a real "industrialization" at the hands of AI, a big worry given that models are already "routinely producing very plausible falsehoods." "What this technology is going to do is it's just going to fill our world with imperceptible falsehoods," he said. "That makes it very hard to distinguish truth from fiction."Other problems could also ensue. Yacine Jernite, a research scientist at the AI company Hugging Face, sees plenty of reason to be concerned about AI chatbots being used for financial scams. "What you need to scam someone out of their money is to build a relationship with them. You need something that's going to chat to them and feel engaged," he said. "That is not just the misuse of chatbots — it is the primary use of the chatbots and what they're trying to be better at."Khlaaf, meanwhile, sees a much more widespread risk: a wholesale dismantling of scientific integrity, extreme exaggeration of "stereotypes that harm marginalized communities," and the untold physical dangers of AI's deployment into safety-critical domains such as medicine and transport.Experts are clear that AI is still far from its full potential, but the tech is developing fast. OpenAI itself is moving with speed to release new iterations of its model. GPT-4, an upgraded version of ChatGPT, is on the horizon. But the disruptive power of AI and the dangers it poses are already apparent. For leaders, it's the "ask for forgiveness later" approach, Mitchell said.Zuckerberg's biggest mistake was allowing ethics to play second fiddle to profitability. <a href="https://www.businessinsider.com/meta-vip-facebook-instagram-cross-check-oversight-board-2022-12">Facebook's creation of an oversight board</a> is a sign that the company is ready to take some responsibility, though many would argue that it's too little, too late to slay the demons unleashed by the platform. And now Altman faces the same dilemma.Altman has shown some signs that he is aware of AI's prospective harms. "If you think that you understand the impact of AI, you do not understand and have yet to be instructed further. if you know that you do not understand, then you truly understand. (-alan watts, sort of)," he <a href="https://twitter.com/sama/status/1621556257323888641?s=20&amp;t=YgO5E091mFuaVJRjm9r-Iw" target="_blank" rel="noopener">tweeted</a> on February 3. That said, researchers have little insight into the data that has been fed into OpenAI's machine, despite several calls made for OpenAI to, in fact, be open. Lifting the lid on its black box would go a long way toward showing it's serious about its issues.Columbia's Wang does think Altman is grappling with the consequences of AI — whether it's to do with the fairness, accuracy, or transparency of it. But abiding by an ethics system that makes sure to do no harm, while trying to scale up the next big thing in tech, "is almost impossible," according to Wang."If you look at his tweets recently, he's sensitive to all of these issues, but the problem with being sensitive to all of these issues is that there are invariably going to be contradictions with what you can achieve," Wang said.The glacial pace with which regulators decided to act against Facebook is unlikely to change once they decide to get serious about policing the threats posed by AI. It means Altman will be left largely unchecked to open AI's Pandora's box. Social media amplified society's issues, as Wooldridge puts it. But AI could very well create new ones. Altman will need to get this right, for everyone's sake. Otherwise, it could be lights out for all.<a href="https://www.businessinsider.com/author/hasan-chowdhury">Hasan Chowdhury</a> is a technology reporter at Insider.

Facebook and Twitter scrambled our brains and poisoned our politics. AI poses an even bigger threat.

You Searched For "chat gpt medicine" and got 3 results

Online mental health company uses ChatGPT to help respond to users in experiment — raising ethical concerns around healthcare and AI technology

Bethany Biron

After passing another medical exam, ChatGPT is moving one step closer to ChatMD

Hilary Brueck

Facebook and Twitter scrambled our brains and poisoned our politics. AI poses an even bigger threat.

Hasan Chowdhury

Popular Keywords

Buying Guides