# Archive Time Buckets - 180/30/5/1 minute bucket ranges **URL:** \ **Category:** Developers\ **Created:** [April 12, 2021, 4:54am UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149 "2021-04-12T04:54:01Z")\ **Posts on this page:** 16\ **Page:** 1
**Author:** ![Lux4rd0](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/lux4rd0/32/11359_2.png) [@Lux4rd0](https://community.tempest.earth/u/Lux4rd0)\ **Post date:** [April 12, 2021, 4:54am UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/1 "2021-04-12T04:54:01Z")
Hopefully a quick question on pulling previous archive data when using the time filters. When I read: “Observation data at a one minute time resolution is available for a time range that is five days or less.” I took that to mean “5 days of one-minute time resolution data” - but it looks like it’s really “up to 5 days”. Is there an easier way of knowing how many days out I should request data to get each of the resolutions available? If I go out past 30 days, it’s 180-minute buckets. From 6-30 days is 30-minute buckets. from 1-5 days it’s 5 minutes. And 1 day or less it’s 1 minute. Does that seem correct? Will there ever be 1-minute intervals for more than the last 24 hours? Thanks! ---
**Author:** ![peter](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/peter/32/1365_2.png) [@peter](https://community.tempest.earth/u/peter)\ **Post date:** [April 12, 2021, 10:37am UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/2 "2021-04-12T10:37:36Z")
Can you share the link to where you were reading this? I couldn’t find it from searching. The last time I played with this, the length of the archive bucket depended on the length of the data window you were requesting, not how long ago that window occured. For example, you can get one minute data for observations recorded last week/month/year, as long as you don’t request more than 24 hours worth of data at once. ---
**Author:** ![sunny](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/sunny/32/16368_2.png) [@sunny](https://community.tempest.earth/u/sunny)\ **Post date:** [April 12, 2021, 1:08pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/3 "2021-04-12T13:08:01Z")
actually you can get 1 minute data as well. If you go to [Tempest API](https://weatherflow.github.io/Tempest/api/swagger/) and authorize, find your device id and request for example data from 40 days ago ([https://swd.weatherflow.com/swd/rest/observations/device/110506?day\_offset=40&format=csv](https://swd.weatherflow.com/swd/rest/observations/device/110506?day_offset=40&format=csv)) I’ll get: ```auto "device_id","type","bucket_step_minutes","timestamp","wind_lull","wind_avg","wind_gust","wind_dir","wind_interval","pressure","temperature","humidity","lux","uv","solar_radiation","precip","precip_type","strike_distance","strike_count","battery","report_interval","local_daily_precip","precip_final","local_daily_precip_final","precip_analysis_type" 110506,obs_st,1,1614729600,0,0,0,0,15,1028.6,4.1,94,0,0,0,0,0,0,0,2.48,1,0,,,0, 110506,obs_st,1,1614729660,0,0,0,0,15,1028.6,4,94,0,0,0,0,0,0,0,2.49,1,0,,,0, 110506,obs_st,1,1614729720,0,0,0,0,15,1028.6,4,94,0,0,0,0,0,0,0,2.49,1,0,,,0, 110506,obs_st,1,1614729780,0,0.11,0.45,178,15,1028.5,4,94,0,0,0,0,0,0,0,2.48,1,0,,,0, 110506,obs_st,1,1614729840,0,0,0,0,15,1028.5,4,94,0,0,0,0,0,0,0,2.49,1,0,,,0, 110506,obs_st,1,1614729900,0,0,0,0,15,1028.5,4,94,0,0,0,0,0,0,0,2.49,1,0,,,0, 110506,obs_st,1,1614729960,0,0,0,0,15,1028.5,4,94,0,0,0,0,0,0,0,2.48,1,0,,,0, ``` The forth number is the unix timestamp in seconds, and you can see it goes up by 60 seconds. ---
**Author:** ![sunny](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/sunny/32/16368_2.png) [@sunny](https://community.tempest.earth/u/sunny)\ **Post date:** [April 12, 2021, 1:21pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/4 "2021-04-12T13:21:30Z")
it is mentioned in the description of the api call. [Tempest API](https://weatherflow.github.io/Tempest/api/swagger/#/observations) ---
**Author:** ![Lux4rd0](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/lux4rd0/32/11359_2.png) [@Lux4rd0](https://community.tempest.earth/u/Lux4rd0)\ **Post date:** [April 12, 2021, 2:10pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/5 "2021-04-12T14:10:47Z")
This response makes total sense. Appreciate the nudge it thinking about this differently. What I was doing was keeping my “time\_end” date “now” and my “time\_start” rolling back over time (by days). The buckets I mentioned were seen as I went from 1 day to N days out. I didn’t chunk the request by individual days. 🙂 I was also thinking of this just in an export fashion - where I was thinking “give me everything” and not being so targeted. But this makes way more sense from an “actively asking for information in real-time” for the exact time that I want. Which - LOL - now has me re-envisioning just using a live JSON connection instead of importing data into my TSDB. (I’ll probably do both!!) Also makes sense why there’s an offset for days. Thanks @sunny - I was always calculating a timestamp before the request! Thank you for the nudge in the right direction!! ---
**Author:** ![iladyman](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/iladyman/32/2305_2.png) [@iladyman](https://community.tempest.earth/u/iladyman)\ **Post date:** [April 13, 2021, 12:50pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/6 "2021-04-13T12:50:42Z")
> [@Lux4rd0](#): > > has me re-envisioning just using a live JSON connection instead of importing data into my TSDB. Hi @Lux4rd0 , Your thoughts are what I have found works well for me so I posted where I am at with my approach, see: > [@My graphs for wind and weather](https://community.tempest.earth/t/my-graphs-for-wind-and-weather/13158): > > Hi graph people, Since working as a power station operator I know the value of charts or graphs and I must see my wind information on a chart to give me the best clues to the trends. For example I like to see the direction of the gust as the gust direction which is often different to the average direction. Since I had not seen the graphs that I wanted available anywhere I set about teaching myself linux and python on a raspberry pi to create my own. I use the API to get the data and draw the w… cheers Ian 🙂 ---
**Author:** ![Lux4rd0](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/lux4rd0/32/11359_2.png) [@Lux4rd0](https://community.tempest.earth/u/Lux4rd0)\ **Post date:** [April 13, 2021, 1:26pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/7 "2021-04-13T13:26:55Z")
For sure!! I spent a little bit of time on this yesterday, and it worked out well for me: ![weatherflow_api_only](https://us1.discourse-cdn.com/flex020/uploads/sws/original/2X/a/a36c0dfa053525e377322972d38c67d20e142f4f.png) About 90% of what I wanted to build works well with live API data - the rest deals more with transformations and usability. And to test using OAuth rather than tokens for better-shared security. But it helped me get a better idea of what I can do at least!! Nice job on your build as well!! ---
**Author:** ![iladyman](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/iladyman/32/2305_2.png) [@iladyman](https://community.tempest.earth/u/iladyman)\ **Post date:** [April 13, 2021, 1:47pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/8 "2021-04-13T13:47:19Z")
I fix some issues when I convert the json from the API into my json. I notice that you are displaying lots of zero minimum wind readings. They may be correct, but there is an issue with minimum wind speed and glitches of zero which are known errors. So if I am calculating the minimum wind speed for a 10 min period then I do not include a single zero reading into the calculation for that period. As my code reads the values to create my own json file of converted values it only uses a zero speed if it followed another zero. Cheers Ian 🙂 ---
**Author:** ![sunny](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/sunny/32/16368_2.png) [@sunny](https://community.tempest.earth/u/sunny)\ **Post date:** [April 13, 2021, 1:56pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/9 "2021-04-13T13:56:01Z")
good… even better because you seem to be using a fixed period of 10 minutes, unlike weatherflow’s implementation which changes the period depending on the zoom level of the graph. ---
**Author:** ![iladyman](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/iladyman/32/2305_2.png) [@iladyman](https://community.tempest.earth/u/iladyman)\ **Post date:** [April 13, 2021, 9:28pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/10 "2021-04-13T21:28:00Z")
I use different time periods depending on the time span of the graph and how crowded the icons become. I mentioned 10 minutes as an example of my technique to reduce the zero wind errors. ---
**Author:** ![sunny](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/sunny/32/16368_2.png) [@sunny](https://community.tempest.earth/u/sunny)\ **Post date:** [April 13, 2021, 9:31pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/11 "2021-04-13T21:31:41Z")
in my opinion wind lull should be defined as the minimum wind during some period (say 10 minutes). When zooming out, one should average those values. Weatherflow currently takes the minimum of a larger period. As a result of this, if you want to see how lull varies over the seasons, you are out of luck, as it is just a graph of zero’s. ---
**Author:** ![Lux4rd0](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/lux4rd0/32/11359_2.png) [@Lux4rd0](https://community.tempest.earth/u/Lux4rd0)\ **Post date:** [April 13, 2021, 10:15pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/12 "2021-04-13T22:15:04Z")
I’d love to understand this scenario more as long-term metrics is something I’m certainly interested in but just now getting some data. (Is this from local 3-second local polling or just the 1-minute averages?) Where are the zeros happening? (My example is 3 months at 6-hour increments. Do I need to dive into 1-minute data? And over what time? ![wind_3_months_6_hours](https://us1.discourse-cdn.com/flex020/uploads/sws/original/2X/a/a3ab1ef0bbd9f02d728661b67e26d561a2e951a0.png) ---
**Author:** ![sunny](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/sunny/32/16368_2.png) [@sunny](https://community.tempest.earth/u/sunny)\ **Post date:** [April 13, 2021, 10:28pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/13 "2021-04-13T22:28:26Z")
your example looks great. but look at what weatherflow does to the lull. When I zoom out it becomes all zero. thats because there is apparently always some zero measurement during the day. Weatherflow’s graph just doesn’t communicate the perceived lull during the day. Note that a zero during the day, might be a single bad measuremend as @iladyman mentioned or it might be a real period sometime during the day with zero wind. but yours doesn’t show that problem. You also display more data, which is good (weatherflow only displays 32 timestamps in the graph). ![Untitled-1](https://us1.discourse-cdn.com/flex020/uploads/sws/original/2X/6/680a86210b9460d65713ea5fdea93415df295181.jpeg) ---
**Author:** ![iladyman](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/iladyman/32/2305_2.png) [@iladyman](https://community.tempest.earth/u/iladyman)\ **Post date:** [April 13, 2021, 11:29pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/14 "2021-04-13T23:29:52Z")
Your top page of 4 graphs had minimum wind showing flat line of zero. But this latest chart does not show the zeros and is called lulls rather tthan minimum. I do not know what you are using for the lull amounts. For my graphs first I ask myself what is important to me. I want to know how good the wind is for paragliding. We talk about gust factor which is how variable the speed is and when it is too gusty I do not fly. I look at the graph and I can see how gusty it is by comparing the average and the maximums over time. Then the minimum causes me to have insufficient lift to soar but I also see it in the detailed chart rather than reading the single amount. When I was younger studying power available for wind mills then I would require different detail. The power is proportional to the square of the speed so using an average and a max and min over a time period is not exactly the power available. If I wanted to know available power then I would use the 3 sec data and add the squares, and also I might adjust the power for direction due to the windmill not turning as quick as the gusts from different directions. If I was to use Sunny’s suggestion I would create another variable named something like average minimum to display. It depends on your purpose. I guess when I am paragliding I can look at my graph of 1min resolution at the lowest of the average wind speeds as my indication if I will not have enough lift to stay up. And I can ignore the minimum sourced from the lowest 3 sec speed. The reason I ignore independent zero minimum speeds is due to glitches which are errors. From my testing I discovered glitches on Skys occuring a couple of times a day or so. I have not tested Tempests for glitches. When the wind is strong all day I do not want a glitch to cause a zero minimum for the day. Cheers Ian 🙂 ---
**Author:** ![sunny](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/sunny/32/16368_2.png) [@sunny](https://community.tempest.earth/u/sunny)\ **Post date:** [April 14, 2021, 9:53am UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/15 "2021-04-14T09:53:25Z")
when I was younger, I studied physics and during my study we had to do about 100 different experiments. One involved a windmill. If I remember correctly (but I might be mistaken) the power from the windmill is proportional with the wind speed to the third power, not the square of the wind speed. anyway, I couldn’t quickly find a general definition of wind lull, but it is supposed to be a short (perhaps a few minutes) period of low wind. Weatherflow’s way of taking the minimum during a 24 hour period (when zoomed out), doesn’t match that definition. My proposal would be to take a sliding window of say 10 minutes and take the minimum during that period. (that still updates every minute). When aggregating the data (when zooming out), just average those measurements. ---
**Author:** ![iladyman](https://sea2.discourse-cdn.com/flex020/user_avatar/community.tempest.earth/iladyman/32/2305_2.png) [@iladyman](https://community.tempest.earth/u/iladyman)\ **Post date:** [April 14, 2021, 1:58pm UTC](https://community.tempest.earth/t/archive-time-buckets-180-30-5-1-minute-bucket-ranges/13149/16 "2021-04-14T13:58:12Z")
> [@sunny](#): > > the power from the windmill is proportional with the wind speed to the third power, not the square of the wind speed. Oh yes I was slack with my memory… I was wrong, yes it is more than only the square: > **[Physics of Wind Turbines | Energy Fundamentals](https://home.uni-leipzig.de/energy/energy-fundamentals/15.htm)** > > An overview of the basic ideas related to the concept of energy thanks Sunny as always 🙂