bug: Hashtag Test doesn't work on particular Bluesky dataset

[sandytribal]

Bug Report

CIB Mango Tree version:

version 0.10.0

Current behavior:

The Hashtag Test on the CLI gets stuck on the processing stage for a Bluesky dataset.

Expected behavior:

It should efficiently and allow me to open the Hashtag Test dashboard.

Steps to reproduce:

Select this dataset - https://drive.google.com/drive/u/0/folders/16yKDmxB4Wb-L9KPgWXr5hwFMqk6AwA6l

The error emerged when I set a parameter of 1 day, and the same error emerged when I tried a parameter of 12 hours. So it may not be related to the parameter length of time.

Related code:

insert short code snippets here

Other information:

[KristijanArmeni]

Thanks @sandytribal ! Good find. This is likely because shorter intervals (1 day, 12 hours) can happen have posts without any hashtags and the created time bucket is empty ("nulls") which leads polars to throw this error. I assume if you set a longer time window (e.g. 5 days), this would not happen.

In any case, we should make sure we deal with this scenario. Noted.

[VEDA95]

Just to chime in, I noticed the dataset your @sandytribal is coming from the api extractor. If so it might be a good idea to install the newest executables available for the extractor. I managed to fix the bug that was excluding the id columns over the holidays.