13 min read

Part 3: Why Your Health Data is a Mess

Your official health record is a useless mess, fragmented across different doctors and insurers. I argue that advertisers at companies like Google and Amazon know more about your daily life and habits than your own physician. Because this foundational data is so broken, new healthcare models like value-based care are failing, and simply applying AI won't fix the problem until the data itself is fixed.

Working in healthcare can feel like navigating a maze in a fog. Doctors are skilled problem solvers, but their maps are often 100 page faxes pieced together from four different electronic health record systems. While the tech world warns that not using AI means falling behind, doctors need to help patients now, with only about 12 minutes for each visit.

The real world is messy. Decisions are made with limited data and time. In an era of highly targeted mobile advertising and wearable supercomputers – the dissidence between data in healthcare and data used to sell you shoes is LOUD.

This post explains specific healthcare data challenges to show a core problem with value based care. By partnering with insurance companies that have poor information, value based care has followed money instead of data. I believe building a foundation on reliable ground truth data, not lagging insurance claims, offers a path to higher quality, data informed care at a lower cost.

What is a health record?

People talk a lot about protecting health records, but what is a health record? Unclear.

At a minimum, it is your name connected to a health facility. That simple combination is protected by laws like HIPAA and security frameworks like HITRUST & SOC 2. A complete health record would ideally contain all your health information like demographics, a full medical history, a list of medications and allergies, and notes from your care team. Hopefully it would also have detailed documents like test results, treatment plans, immunization records, and consent forms.

However, that document doesn’t exist.

Health records in the real world

Your actual 'health record' is more like Marvel's Infinity Stones, scattered across the galaxy, and guarded by different villains.

  • Insurance company asteroid field: Where your past health services go to live, but only for the time you were with them. Think of it as a series of tiny, isolated islands but if you leave the island, the island is destroyed.
  • Primary care planet: Full of notes and forms, but good luck if you ever switch doctors!
  • Prescriptions planet: An actually high functioning planet since Surescripts has an up to date and comprehensive list of your medications. However, the planet is protected by the CVS space force which seems to be dispensing medications for the first time every time you go.
  • Hospital planet: Robust data on surgeries and test results run by that hospital but with strong gravitational pull so that data can come in but never leave.
  • Self-care planet: Where your personal wellbeing battles it out with your Strava KOMs (for all you fitness buffs out there!)

Getting data to travel between these planets is like trying to send a fax to the moon – expensive, slow, and…probably impossible. The financial cost of this lack of interoperability is immense and a whole separate issue from this post.

I personally love watching tortured healthcare engineers try to help each other on the r/healthIT subreddit. Highly recommend!

Your insurance company doesn't have access to the notes from your primary care doctor's visit. If your primary care doctor refers you to the hospital, the hospital will get your records by requesting a fax. None of these people have any idea about your mental health, data from your Apple Watch, or your ability to pay for different treatments.

The real gap in your health record

The thing I think is missing the most about your health is the GOOD in your life. It's like your health record is only interested in your bad days, not your triumphs. This makes it very difficult for providers to connect with patients — they are medical fire fighters rather than trusted partners.

A close family member of mine recently completed a substance recovery program and is doing very well. Their transformation is truly inspiring. They are making huge health progress with their diet and exercise. But, I asked and they have not seen their primary care doctor in years. This is a perfect time to provide support and maintain momentum, but the healthcare system is unaware.

My own (inaccurate) health record

It is illuminating trying to build your own accurate medical record.

While living in New York City, I have visited four different health systems. As I wrote this, I requested my medical records from all four. Each facility had a different list of medications. None had documented my family medical history or a complete list of my vaccinations. None had records of my childhood surgeries or a surgery from 2012. There was no data on my mental health, living environment, or my current physical therapy.

I've also had four different insurance plans in NYC. Since these companies don't share data, each one only has a small piece of my health history.

A third group, the clinical data exchange networks, also has pieces of my health data. These include Health Information Exchanges that send event notifications, Surescripts for medications, and networks like Commonwell and Carequality that allow providers to request records from eachother. Epic's Care Everywhere network allows sharing between providers, but only if the patient has linked those providers in MyChart. Unfortunately, I wasn’t able to request my records from any of these sources.

Even with all the talk about making health data work together, my health record is still wrong. The data we're sharing is garbage. This was my experience at companies like Firsthand and Cityblock. We would find out that patients were taking completely different medications and had different health conditions than we thought. A big part of what we did was just correcting their records.

The missing data

In 15 years in NYC, I’ve been to 5 primary care appointments which — is low! — but isn’t far from average. Data on checkups varies, but studies suggest that a most people do not see a primary care physician every year. This creates huge gaps in time with no data!

Even when you do see a doctor, a lot of information gets left out. I told my doctor about my knee pain and some of the vitamins I take, but I didn't mention everything. This is normal. Studies show that 60-80% of people don't tell their doctors everything. They might forget, be embarrassed, or just not want to be a difficult patient.

My doctor seemed rushed. After the appointment, I opened Instagram and saw an ad for something I wanted to buy.

Do you know who has more real time data about how I’m doing? Google, Facebook, Amazon.

Sell me healthcare

It sounds crazy, but combining advertising data with medical records could transform healthcare.

Advertisers know your age, where you live, your job, and your interests. They have your location history and know what you like based on what you read and follow online.

Unlike health data, which is scattered and incomplete, the advertising industry has detailed profiles on most Americans, sometimes going back decades. Google knows what you're interested in, Meta knows your social connections, and Amazon knows what you buy.

Your doctor and health researchers don't have access to any of this information. Combining these datasets could help us understand if medications and surgeries are actually working from how people’s behavior online changes after treatment.

While there are major privacy concerns for more centralized systems, our current system is doing a terrible job of protecting our health data. In 2024 alone, patient records for ~276 million Americans were breached (ref). The dark web may have more accurate health data for me than my doctor.

The fragmentation of our health system is itself a security risk. Regular business operations require transmitting data between countless parties using data security standards customized for each one. It is a complex issue perhaps for another blog post.

In a perfect world

Success in value-based care depends on good data. The goal for a VBC company is to give the right treatment to the right person at the right time. Value-based care companies try to do this by specializing in certain conditions, like diabetes.

The process is supposed to be simple:

  1. Partner with an insurance plan.
  2. Select a group of people with a specific health condition.
  3. Group them by location.
  4. Assign them to local care teams.
  5. Prioritize them based on need.
  6. Engage them and provide care.

But it's almost impossible to get accurate, up-to-date health data. Just identifying people with diabetes is a huge challenge.

The problem with claims data

It is impossible to find the patients who need help the most when they need it.

At my previous companies, we had major problems with insurance claims data

  • Missing or low insurance claims for 30-50% of the identified population
  • Cost information had been stripped from the claims (paid amounts)
  • Claims arrive monthly and include data that is at least 3 months old
  • More than 30% of the people on the list would change insurance plans each year.

Even when claims data is good, it only shows what happened under that one insurance plan. Information from when you had a different job or insurer is missing. Details about your mental health, housing, or food situation are not included.

A value-based care company can get more records if they meet the patient and get them to sign a consent form. But by then, they've already committed to caring for that person, even if they've moved, are sicker than expected, or are in jail.

We once had an insurance partner tell us that two different patients were actually the same person and that one of them had died. We called the family to offer our condolences, but it turned out they weren't the same person. We then had to fix the merged medical records and apologize to the family. In 2025, value-based care companies are still being assigned patients who are dead or in jail!

Who does this well?

E-commerce companies have spent billions of dollars building systems to track customers and their purchases. With AI, they're getting even better at predicting what people will buy, how much they will pay and when they will buy it.

The healthcare industry never paid those big data billions, so we don't know what happens to patients after they leave the doctor's office. AI can't fix this because the data is too flawed to be reliable. We can't tell if an AI is right or just making things up. Our health data is missing basic information like demographics, interests, fitness data, and the patient's own view of their health. The data that does exist is often both inaccurate and incomplete as it was for me.

No one in healthcare can answer these simple questions:

  • Did you go to the specialist I referred you to?
  • Do you feel like your health is getting better or worse?
  • Did you take your medication today?
  • Are you in jail?
  • Are you still eligible for your health insurance?
  • What are your parents' medical conditions?
  • Do you have any mental health or substance use issues?
  • Do you have a stable income and place to live?
  • Have you had any big life events recently?
  • Have you filled out our consent form?

Here's the wild part: Someone trying to sell you shoes could answer more of those questions than your own doctor!

Gravity always wins

Today, value based care companies primarily partner with insurance companies. Gravity is dollar savings in the form of reduced medical spend & increased reimbursement. It pulls all value based care into its orbit.

In an AI world, ‘data is the new gravity’ and will drive the next wave of healthcare innovation. Healthcare has spent many billions trying to squeeze water out of the rock that is insurance claims data.

It turns out, we've been looking for the princess in the wrong castle all along. She's not with the insurance companies; she's chilling out at Epic (or maybe even Google or Facebook). The future of value based care will be built around companies with rich data and a real information asymmetry to existing players and to insurance companies.

Healthcare should keep patients at the center. Most data sharing efforts have put companies before consumers, focusing on reducing the risk of getting sued or fined instead of improving the customer experience.

Contacting a mother to offer condolences for their dead son when their son is not actually dead is not a great patient experience! If the U.S. wants to control healthcare costs, it needs a universal system with accurate, complete information.

Main takeaways

  • Current health data is often inaccurate and was created for billing, not for creating a complete patient record.
  • Health records are missing key information about a person's life that could improve their care. The missing data is from inconsistent PCP visits, lack of social determinants & mental health data as well as not tracking positive factors of someone’s well-being.
  • Data from sources like someone’s online presence and advertisers could provide better and more timely information about a person's well-being.

I am hopeful about the future

For value-based care to finally follow the data, a few things need to change. While pressure can come from different directions, meaningful progress likely starts with a new foundation built on better policy.

Meaningful change starts with policy. If the government creates a unified patient ID and enforces modern data-sharing agreements like TEFCA, could push toward a single source of truth for every patient. This foundational layer would make it possible for real innovation to happen, rather than creating even more competing data sources.

Once that foundation is in place, other players can start to build on it:

  • Patients, empowered by their own data, could use new AI tools to navigate the health system. I am particularly optimistic here since consumers could be motivated to improve the accuracy of their health record by the promise of higher quality, most integrated care.
  • Big Tech companies like Apple or Google could re-enter the space, using this new data infrastructure to create a truly useful health record for their users. By combining clinical data with information from their own platforms (like wearable data), they could sell access to value-based care companies, creating a new market based on rich, real-time information.
  • Hospitals and Accountable Care Organizations (ACOs) could more easily partner with value-based care companies. With access to better data from EHRs, VBC companies could more effectively deploy preventative care and care management. Financial pressures, like reduced Medicaid eligibility, may motivate Hospitals and ACOs to find proactive solutions for keeping people healthy and out of the emergency room. Data standards could lower the integration cost with the myriad of partners required.

My main worry is that the healthcare industry is rushing to use AI without first fixing the data. This could lead to people being denied the care they need because of an incomplete and inaccurate health record.

While this is a lot! It is just one of post my attempt to share some things I’ve learned.

In the next post, we'll dive into value-based contracting, so stay tuned!

Recommended reading

Why Value-Based Care is Harder Than Rocket Science

This series argues that U.S. healthcare is "harder than rocket science" due to its "consolidated fragmentation," where powerful, siloed players hinder effective, affordable patient care. The main conclusion is that in an era of AI and consolidation, we need a major shift in data policy to deliver on the promise of improved quality of care at reduced cost.

Part 1: What is “healthcare” in the US

Part 2: What is Value-Based Care?

Part 3: Why Your Health Data is a Mess

September 2025

The wide business: VBC through the lens of operations research

Recommended Writing

10 min read

An introduction to building software for value-based care

This post argues that building successful software for value-based care (VBC) requires a shift in mindset: create a Customer Relationship Management (CRM) tool, not just a better Electronic Health Record (EHR). VBC realigns healthcare incentives around long-term patient outcomes, succeeding through proactive, relationship-based care rather than transactional services. Technology's role is to support this relationship by helping care teams orchestrate interventions effectively. The most valuable tools are often simple and pragmatic, focusing on the unique, core needs of the care model and enabling proactive management of patient health.

6 min read

Learnings from building Kelp: Getting people the information they need when they need it is hard!

Reflections on pausing the contextual recommendation tool, Kelp, concluding that its goal—getting people the right information at the right time—is nearly impossible for a third-party app to achieve. The core problem is technical: without deep, OS-level access to user data and behavioral signals, recommendations remain mediocre. True contextual help must be built into the operating system itself. The key business takeaway was the need to solve a highly specific, paying use case for a narrow audience before attempting a broad, cross-platform solution.

8 min read

Learning from a Hyper-Growth Startup

This reflection on leadership in a hyper-growth startup argues that self-management is the most crucial skill. Management in such a chaotic environment is inherently reactive and emotionally draining, not strategic and proactive. The key to effectiveness is to abandon "ruinous empathy"—the futile attempt to please everyone—and instead fiercely conserve personal energy for high-impact moments. This is achieved by accepting failure and tradeoffs as constant, communicating them transparently, and focusing on maximizing success in key areas rather than fighting every fire.

7 min read

Is Buying in Brooklyn Worth It?

Brooklyn homeownership is not "worth it" as a financial investment. After accounting for renovation costs, high transaction fees, and the opportunity cost of not investing in the stock market, my profitable-on-paper sale was actually a financial loss. The true costs were the non-financial headaches: months of living in construction dust, battling city bureaucracy over permits, and fixing bank errors over property liens. I conclude that you buy a home not for the return, but for the control and satisfaction of making a space your own.

Recommended Photos