flask-admin list view is too slow for large table
0
I have a table which has about 35,000,000 rows, It took more than 15 seconds to showing the list view of the table by using flask-admin, how can I speed it up?
flask flask-sqlalchemy flask-admin
asked Nov 23 '18 at 14:55
Jas6033Jas6033
459
add a comment |
0
I have a table which has about 35,000,000 rows, It took more than 15 seconds to showing the list view of the table by using flask-admin, how can I speed it up?
flask flask-sqlalchemy flask-admin
asked Nov 23 '18 at 14:55
Jas6033Jas6033
459
What's the database, model definition and view definition? Install Flask-DebugToolbar and analyze the query/queries(!) being executed.
– pjcunningham
Nov 25 '18 at 10:45
It's actually more depends on your database and table structure, more than on flask-admin. One of possible improvements, try to optimize count query.
– Zaytsev Dmitry
Nov 25 '18 at 10:45
I'm using postgresql, yes, the count query is too slow
– Jas6033
Dec 12 '18 at 10:36
add a comment |
0
0
0
I have a table which has about 35,000,000 rows, It took more than 15 seconds to showing the list view of the table by using flask-admin, how can I speed it up?
flask flask-sqlalchemy flask-admin
asked Nov 23 '18 at 14:55
Jas6033Jas6033
459
I have a table which has about 35,000,000 rows, It took more than 15 seconds to showing the list view of the table by using flask-admin, how can I speed it up?
flask flask-sqlalchemy flask-admin
flask flask-sqlalchemy flask-admin
asked Nov 23 '18 at 14:55
Jas6033Jas6033
459
asked Nov 23 '18 at 14:55
Jas6033Jas6033
459
edited Nov 24 '18 at 0:45
Jas6033
asked Nov 23 '18 at 14:55
Jas6033Jas6033
459
asked Nov 23 '18 at 14:55
Jas6033Jas6033
459
asked Nov 23 '18 at 14:55
Jas6033Jas6033
459
459
What's the database, model definition and view definition? Install Flask-DebugToolbar and analyze the query/queries(!) being executed.
– pjcunningham
Nov 25 '18 at 10:45
It's actually more depends on your database and table structure, more than on flask-admin. One of possible improvements, try to optimize count query.
– Zaytsev Dmitry
Nov 25 '18 at 10:45
I'm using postgresql, yes, the count query is too slow
– Jas6033
Dec 12 '18 at 10:36
add a comment |
What's the database, model definition and view definition? Install Flask-DebugToolbar and analyze the query/queries(!) being executed.
– pjcunningham
Nov 25 '18 at 10:45
It's actually more depends on your database and table structure, more than on flask-admin. One of possible improvements, try to optimize count query.
– Zaytsev Dmitry
Nov 25 '18 at 10:45
I'm using postgresql, yes, the count query is too slow
– Jas6033
Dec 12 '18 at 10:36
What's the database, model definition and view definition? Install Flask-DebugToolbar and analyze the query/queries(!) being executed.
– pjcunningham
Nov 25 '18 at 10:45
What's the database, model definition and view definition? Install Flask-DebugToolbar and analyze the query/queries(!) being executed.
– pjcunningham
Nov 25 '18 at 10:45
It's actually more depends on your database and table structure, more than on flask-admin. One of possible improvements, try to optimize count query.
– Zaytsev Dmitry
Nov 25 '18 at 10:45
It's actually more depends on your database and table structure, more than on flask-admin. One of possible improvements, try to optimize count query.
– Zaytsev Dmitry
Nov 25 '18 at 10:45
I'm using postgresql, yes, the count query is too slow
– Jas6033
Dec 12 '18 at 10:36
I'm using postgresql, yes, the count query is too slow
– Jas6033
Dec 12 '18 at 10:36
add a comment |
1 Answer
1
active
oldest
votes
0
If you're using postgresql you can override flask-admin count function using pg_class table which can return approximate count of table very fast
count = self.session.execute(
"""
SELECT reltuples::bigint AS count
FROM pg_class
WHERE oid = '{0}'::regclass
""".format(self.model.__table__.fullname)
).scalar()
answered Feb 5 at 11:28
Zaytsev DmitryZaytsev Dmitry
5131518
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53448886%2fflask-admin-list-view-is-too-slow-for-large-table%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
0
If you're using postgresql you can override flask-admin count function using pg_class table which can return approximate count of table very fast
count = self.session.execute(
"""
SELECT reltuples::bigint AS count
FROM pg_class
WHERE oid = '{0}'::regclass
""".format(self.model.__table__.fullname)
).scalar()
answered Feb 5 at 11:28
Zaytsev DmitryZaytsev Dmitry
5131518
add a comment |
0
If you're using postgresql you can override flask-admin count function using pg_class table which can return approximate count of table very fast
count = self.session.execute(
"""
SELECT reltuples::bigint AS count
FROM pg_class
WHERE oid = '{0}'::regclass
""".format(self.model.__table__.fullname)
).scalar()
answered Feb 5 at 11:28
Zaytsev DmitryZaytsev Dmitry
5131518
add a comment |
0
0
0
If you're using postgresql you can override flask-admin count function using pg_class table which can return approximate count of table very fast
count = self.session.execute(
"""
SELECT reltuples::bigint AS count
FROM pg_class
WHERE oid = '{0}'::regclass
""".format(self.model.__table__.fullname)
).scalar()
answered Feb 5 at 11:28
Zaytsev DmitryZaytsev Dmitry
5131518
If you're using postgresql you can override flask-admin count function using pg_class table which can return approximate count of table very fast
count = self.session.execute(
"""
SELECT reltuples::bigint AS count
FROM pg_class
WHERE oid = '{0}'::regclass
""".format(self.model.__table__.fullname)
).scalar()
answered Feb 5 at 11:28
Zaytsev DmitryZaytsev Dmitry
5131518
answered Feb 5 at 11:28
Zaytsev DmitryZaytsev Dmitry
5131518
answered Feb 5 at 11:28
Zaytsev DmitryZaytsev Dmitry
5131518
answered Feb 5 at 11:28
Zaytsev DmitryZaytsev Dmitry
5131518
5131518
add a comment |
add a comment |
draft saved
draft discarded
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53448886%2fflask-admin-list-view-is-too-slow-for-large-table%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
What's the database, model definition and view definition? Install Flask-DebugToolbar and analyze the query/queries(!) being executed.
– pjcunningham
Nov 25 '18 at 10:45
It's actually more depends on your database and table structure, more than on flask-admin. One of possible improvements, try to optimize count query.
– Zaytsev Dmitry
Nov 25 '18 at 10:45
I'm using postgresql, yes, the count query is too slow
– Jas6033
Dec 12 '18 at 10:36