Archive - Pensieve

Debugging Pip Extras: A Deep Dive into .whl Files

Jan 8 •

July 2018

Writing Into Dynamic Partitions Using Spark

Hive has this wonderful feature of partitioning — a way of dividing a table into related parts based on the values of certain columns.

Jul 12, 2018 •

May 2017

Parse Json in Hive Using Hive JSON Serde

In an earlier post, I wrote a custom UDF to read JSON into my table.

May 25, 2017 •

April 2017

Writing UDF To Parse JSON In Hive

Every so often, we need to perform data transformation in ways too complicated for SQL (even with the Custom UDF’s provided by hive).

Apr 5, 2017 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts