Index Supply

@indexsupply

1 Following

502 Followers

Nick T pfp

chat we have realtime trades 🔥🔥🔥 data from @indexsupply

0 reply

1 recast

17 reactions

Index Supply pfp

We've got plenty of indexes around these parts ;)

1 reply

0 recast

1 reaction

Index Supply pfp

It's the same query without the address. If the underlying data is cached (in pg's shared buffers or the OS's page cache) (it is as of this cast) then there will be no difference. This particular query is on the slower side simply because of how many rows are being returned. I'm not saying that queries without addresses will always have a penalty, but in this particular case, adding the address predicate will increase cache hit rate because fewer file system pages are needed. And when it's not cached it will be quicker for the same reason.

1 reply

1 recast

3 reactions

Index Supply pfp

If you are querying WowTokenCreated on the Index Supply free plan, please reach out to me as I have a query suggestion for you. It will bring your cold query latency from a couple of seconds down to ~150ms. here is the faster query: https://tinyurl.com/wowtoken-with-addr

2 replies

3 recasts

21 reactions

Index Supply pfp

Fun Query for this Friday: Token Balances for a Wallet https://tinyurl.com/token-balance

1 reply

3 recasts

47 reactions

Index Supply pfp

SQL CASE Now Supported Here is a fun query from @liam.eth showcasing World App User Migrations on the World Chain. https://tinyurl.com/wrldchain

2 replies

20 recasts

134 reactions

Index Supply pfp

We track every API query and carefully study the latency. Now you can too! Fast is a feature. This number is the time it took us to serve the request. It does not include client download and decoding. Which, depending on your client and your location may be significant. But hopefully not.

0 reply

2 recasts

15 reactions

Index Supply pfp

Queries using indexed fields typically run in sub-millisecond time. So you'll never see the loading indicator. But, If you query a contract with ¼ × 10⁶ rows then we have to do an index scan, and send the data; which, even on dialed hardware, can take time. And for these cases, there is now a fun loading indicator. (it’s database themed)

0 reply

10 recasts

77 reactions

Ryan pfp

I'm hiring a programmer for @indexsupply - Ideal for someone wanting mentorship/growth - Rust, Postgres, EVM - I care deeply about quality - $150k, SF or West Coast or USA https://www.indexsupply.com/engineer-1

6 replies

18 recasts

80 reactions

Index Supply pfp

ty for the kind words and right back atcha!

0 reply

0 recast

0 reaction

Index Supply pfp

SQL API CHANGELOG 1. nested expressions `where a and (b or c)` 2. min/max aggregate functions `max(block_num) from transfer` 3. fix bool predicates `where spent = true` 4. Added mainnet and zora chains

0 reply

0 recast

2 reactions

Index Supply pfp

Few know this, but Shovel includes a nice little PG migration system to create indexes, unique indexes, and deals with adding columns to prev. defined tables! Here is a "index" example. Learn more here: https://indexsupply.com/shovel/docs/#table

1 reply

0 recast

13 reactions

Ryan pfp

Thrilled to announce Shovel 1.0! Since the beta release in Nov 2023 we found and fixed the major bugs, tuned the performance, and added a few small nice-to-haves. The 1.0 release is a nice stamp on a maturing code base and indicates its production readiness for Ethereum indexing projects.

3 replies

5 recasts

14 reactions

Index Supply pfp

New TS package for building Shovel config: https://indexsupply.com/shovel/docs/#typescript

0 reply

6 recasts

9 reactions

Index Supply pfp

If you came here from X (fka twitter), this is the very important announcement that I referenced. Thank you.

1 reply

0 recast

1 reaction

Index Supply pfp

Shovel now logs on each tick: nrows=X nrpc=Y nblocks=Z - number of rows inserted into Postgres - number of rpc calls made to process - number of blocks processed https://indexsupply.com/shovel/docs/#logging

1 reply

1 recast

4 reactions

Index Supply pfp

Added a diagnostics endpoint to Shovel. It will show you a comparison of the latest block in the db/node. Latency for db/node operations. And any errors encountered along the way. https://indexsupply.com/shovel/docs/#monitoring

0 reply

0 recast

23 reactions

Index Supply pfp

May you prove many things with zero knowledge and prosper.

0 reply

0 recast

2 reactions

Index Supply pfp

Nice. The JSON RPC path is the most stable path at this point. Everything in the docs should work well. https://indexsupply.com/shovel/docs/ Ping me if you hit any snags or need something new and I'll get to work.

1 reply

0 recast

1 reaction

Index Supply pfp

Hi. Shovel (fka E2PG) can load data in 1 of 3 ways. It can use JSON RPC (common, easy, not the fastest), the Block API (fka RLPS. uncommon, easy, faster), or it can read directly from Geth's freezer files (needs full node, hard, extremely fast)

1 reply

1 recast

4 reactions