pandas dataframe O(1) index by column
up vote
0
down vote
favorite
I have a large dataframe and want to support O(1) index by one column. I tried set_index but that seems to be not that fast when using with iloc. Any thoughts on how to speed this up?
python pandas
asked Nov 20 at 1:20
Mr.cysl
169216
add a comment |
up vote
0
down vote
favorite
I have a large dataframe and want to support O(1) index by one column. I tried set_index but that seems to be not that fast when using with iloc. Any thoughts on how to speed this up?
python pandas
asked Nov 20 at 1:20
Mr.cysl
169216
4
Not sure what you mean bysupport O(1) index by one column
– RafaelC
Nov 20 at 1:25
Pandas indices are effectively hash tables.pd.Indexcan only contain hashable items. One way to get a bit more speedup is by making sure the index doesn't contain duplicates. I believe the getitem lookup is O(1) when both of those conditions are satisfied
– Brad Solomon
Nov 20 at 2:07
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I have a large dataframe and want to support O(1) index by one column. I tried set_index but that seems to be not that fast when using with iloc. Any thoughts on how to speed this up?
python pandas
asked Nov 20 at 1:20
Mr.cysl
169216
I have a large dataframe and want to support O(1) index by one column. I tried set_index but that seems to be not that fast when using with iloc. Any thoughts on how to speed this up?
python pandas
python pandas
asked Nov 20 at 1:20
Mr.cysl
169216
asked Nov 20 at 1:20
Mr.cysl
169216
asked Nov 20 at 1:20
Mr.cysl
169216
asked Nov 20 at 1:20
Mr.cysl
169216
asked Nov 20 at 1:20
Mr.cysl
169216
169216
4
Not sure what you mean bysupport O(1) index by one column
– RafaelC
Nov 20 at 1:25
Pandas indices are effectively hash tables.pd.Indexcan only contain hashable items. One way to get a bit more speedup is by making sure the index doesn't contain duplicates. I believe the getitem lookup is O(1) when both of those conditions are satisfied
– Brad Solomon
Nov 20 at 2:07
add a comment |
4
Not sure what you mean bysupport O(1) index by one column
– RafaelC
Nov 20 at 1:25
Pandas indices are effectively hash tables.pd.Indexcan only contain hashable items. One way to get a bit more speedup is by making sure the index doesn't contain duplicates. I believe the getitem lookup is O(1) when both of those conditions are satisfied
– Brad Solomon
Nov 20 at 2:07
4
4
Not sure what you mean by
support O(1) index by one column– RafaelC
Nov 20 at 1:25
Not sure what you mean by
support O(1) index by one column– RafaelC
Nov 20 at 1:25
Pandas indices are effectively hash tables.
pd.Index can only contain hashable items. One way to get a bit more speedup is by making sure the index doesn't contain duplicates. I believe the getitem lookup is O(1) when both of those conditions are satisfied– Brad Solomon
Nov 20 at 2:07
Pandas indices are effectively hash tables.
pd.Index can only contain hashable items. One way to get a bit more speedup is by making sure the index doesn't contain duplicates. I believe the getitem lookup is O(1) when both of those conditions are satisfied– Brad Solomon
Nov 20 at 2:07
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53384911%2fpandas-dataframe-o1-index-by-column%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
4
Not sure what you mean by
support O(1) index by one column– RafaelC
Nov 20 at 1:25
Pandas indices are effectively hash tables.
pd.Indexcan only contain hashable items. One way to get a bit more speedup is by making sure the index doesn't contain duplicates. I believe the getitem lookup is O(1) when both of those conditions are satisfied– Brad Solomon
Nov 20 at 2:07