Buy now

Have you purchased yours? Check your tickets options now and enjoy the discounts offered!

This content is locked

This content is no longer available.

Back
Video content locked

02 December 2020, 06:50 PM

From discovering data to trusting data

A talk by Mark Grover
Product Manager, Lyft

Speaker expertise

Mark is the co-creator of the open-source data catalog and metadata engine, Amundsen. Amundsen is used by data scientists and analysts to discover, understand, and trust data they use. At Lyft, Amundsen has 700+ active users every week, and outside of Lyft, Amundsen is used by 27 companies like Instacart, ING, Square, etc.


At Lyft, we have made our analysts and data scientists over 20% more productive by making it easier to discover data.

Recently, we open sourced Amundsen and it’s now being used by ING, Square, Workday and many more. However, as we made it easy to discover data, it’s led to an interesting challenge.

Not only is it now easy to discover good trusted data, it’s also easier to discover bad data that was previously hidden in the unforgotten nook and crannies of the data lake.

Consequently, we are now asking ourselves, how can we recommend not just any data but trusted data to our users.

This talk gives a quick overview of Amundsen and then goes into detail on how we have tried both automated and curated metadata to showcase what’s trusted and not in Amundsen.

It will dive deep into linking the Airflow DAG which produced the data (task level lineage), linking what and how many dashboards are built from a given data set (table level lineage), as well as SLAs and historical landing times to give users signal into what’s trusted.

The talk will end with an insight into current challenges and how we may solve them in the future.

👉 Book Your Ticket Now


Join the discussion

You need to be registered as an attendee in order to comment on this talk.

RegisterRegister

Categories covered

Media

  • From discovering data to trusting data

Learn from amazing companies like these

Lyft

Proudly supported by

Want to sponsor this event? contact us.