The Hadooponomics Podcast, Episode 16 – Hacking the Stack: Rethinking Coding, the Scientific Method, and Big Data

Hadooponomics16On Hadooponomics this week, we have Jerry Overton, Data Scientist and Distinguished Engineer at Computer Sciences Corporation (CSC), and a teacher, author, and thought leader in using Big Data to influence change in an organization. This week we are action-oriented, looking at the concrete steps Big Data practitioners can take to be more effective at their jobs. We dive into high-impact data science, and the difference between Big Data in theory and Big Data in practice – both how to be personally effective, and how to make an impact at enterprise scale. This episode is particularly relevant to data practitioners, but has insights that resonate across the spectrum of Big Data involvement.

We begin our conversation by discussing the problem of “stack thinking.”  For data practitioners, stack thinking is an isolated view focused on a specific technology layer or component, rather than on how the solution as a whole can create stakeholder value.  Jerry has some advice on how to combat this (hint: focus on outcomes, then choose the tools).

Next we dive into the art of the hack, or how Big Data practitioners can use resources already at their disposal, such as existing code, to evolve solutions rather than build them from scratch. Jerry advises that many Big Data problems can be solved by working with a zero draft that includes pre-existing, or previously written code, and molding the code as needed.

Finally, we confront the echo chamber in Big Data: what creates real value, and what’s just hype. First off: the scientific method. How do we ensure the questions we are asking are valuable, even before the hypothesis stage?  Jerry explores why the scientific method might not be the best approach, and how we can use a new way of thinking to better solve Big Data problems.

Enjoy!

Listen to the Show:

Use the embedded media player to stream the full episode or you can subscribe to our iTunes and Stitcher channels. The full transcript of the interview is also available.

PodcastHadooponomics Podcast Home | Subscribe via iTunes | Stitcher Radio | Transcript

Additional Resources

The Art of the Hack by Logan Wilt

Mastering Data Science at Enterprise Scale via O’Reilly Media

Doing Data Science CSC Blog

Find Jerry on Twitter @JerryAOverton

About Arcadia Data:

Arcadia Data Logo

Arcadia Data unifies visual analysis, business intelligence and data discovery; it runs natively on your Hadoop clusters without data extracts. Its easy-to-use browser-based visualizations deliver secure access for hundreds of concurrent users across hundreds of billions of rows in near-real time.

About James Haight

James Haight is a principal analyst at Blue Hill Research focusing on analytics and emerging enterprise technologies. His primary research includes exploring the business case development and solution assessment for data warehousing, data integration, advanced analytics and business intelligence applications. He also hosts Blue Hill's Emerging Tech Roundup Podcast, which features interviews with industry leaders and CEOs on the forefront of a variety of emerging technologies. Prior to Blue Hill Research, James worked in Radford Consulting's Executive and Board of Director Compensation practice, specializing in the high tech and life sciences industries. Currently he serves on the strategic advisory board of the Bentley Microfinance Group, a 501(c)(3) non-profit organization dedicated to community development through funding and consulting entrepreneurs in the Greater Boston area.
Posted on November 30, 2016 by James Haight

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Latest Blog

VMware's Industry Analyst Day Highlights Drive Toward "Consumer Simple, Enterprise Secure" Voice Continues to Dominate: Apple Releases HomePod, Broadens Siri's Reach IBM and Cisco Systems Team Up for Integrated Cybersecurity Solution, Services, and Threat Intelligence

Topics of Interest

Advanced Analytics

AI

Analytics

Anodot

Attunity

authentication

BI

Big Data

Blog

Business Intelligence

Cloud

Cognitive Computing

Corporate Payments

Data Management

Data Preparation

Data Wrangling

DataKitchen

DataOps

DataRobot

design

design thinking

Domo

Emerging Tech

enterprise applications

Enterprise Performance Management

enterprise video

fog computing

General Industry

GoodData

GRC

Hadoop World

Human Resources

IBM

IBM Interconnect

Iguazio

ILTACON

Informatica

Information Builders

innovation

Internet of Things

IoT

knowledge

legacy IT

Legal

Legal Tech

Log Data

Machine Learning

Managed Mobility Services

Microsoft

Mobility

Nexla

Order-to-Cash

passwords

Pentaho

Podcast

Predictive Analytics

Private Equity

Procure-to-Pay

Qubole

Questioning Authority

Recurring Revenue

Risk Management

ROI

Sales Enablement

Salesforce

Security

service desk

Social Media

Strata

Striim

Supply Chain Finance

Switchboard Software

Tableau

Talend

Tangoe

Telecom Expense Management

Time-to-Value

Trifacta

TWIDO

Unified Communications

usability

USER Applications

User Experience

User Interface

video platform

Virtualization

Visualization

Wearable Tech

Yellowfin