Error importing data to a model in Django
I´m trying to import data from a csv file to a Django model. I´m using the manage.py shell for it with the following code:
>>> import csv
>>> import os
>>> path = "C:\UsersLia LoveDownloads"
>>> os.chdir(path)
>>> from catalog.models import ProductosBase
>>> with open('FarmaciasGob.csv') as csvfile:
... reader = csv.DictReader(csvfile)
... for row in reader:
... p = Country(country=row['Country'], continent=row['Continent'])
... p.save()
...
>>>
>>> exit()
I get the following error message at a given point of the dataset:
UnicodeDecodeError: "charmap" codec can´t decode byte 0x81 in position 7823: character maps to (undefined)
For what I could find, it seems to be a problem with the "latin" encoding of the csv file.
Inspecting the csv, I don´t see nothing special about the specific row where it get´s the error. I´m able to import about 2200 rows before this one, all with latin characters.
Any clues?
python django unicode
asked Nov 23 '18 at 18:57
Francisco GhelfiFrancisco Ghelfi
8712
add a comment |
I´m trying to import data from a csv file to a Django model. I´m using the manage.py shell for it with the following code:
>>> import csv
>>> import os
>>> path = "C:\UsersLia LoveDownloads"
>>> os.chdir(path)
>>> from catalog.models import ProductosBase
>>> with open('FarmaciasGob.csv') as csvfile:
... reader = csv.DictReader(csvfile)
... for row in reader:
... p = Country(country=row['Country'], continent=row['Continent'])
... p.save()
...
>>>
>>> exit()
I get the following error message at a given point of the dataset:
UnicodeDecodeError: "charmap" codec can´t decode byte 0x81 in position 7823: character maps to (undefined)
For what I could find, it seems to be a problem with the "latin" encoding of the csv file.
Inspecting the csv, I don´t see nothing special about the specific row where it get´s the error. I´m able to import about 2200 rows before this one, all with latin characters.
Any clues?
python django unicode
asked Nov 23 '18 at 18:57
Francisco GhelfiFrancisco Ghelfi
8712
This is an issue with encoding are you using python2 or python3?
– 2ps
Nov 23 '18 at 19:10
Using Python 3.7.0
– Francisco Ghelfi
Nov 23 '18 at 19:12
add a comment |
I´m trying to import data from a csv file to a Django model. I´m using the manage.py shell for it with the following code:
>>> import csv
>>> import os
>>> path = "C:\UsersLia LoveDownloads"
>>> os.chdir(path)
>>> from catalog.models import ProductosBase
>>> with open('FarmaciasGob.csv') as csvfile:
... reader = csv.DictReader(csvfile)
... for row in reader:
... p = Country(country=row['Country'], continent=row['Continent'])
... p.save()
...
>>>
>>> exit()
I get the following error message at a given point of the dataset:
UnicodeDecodeError: "charmap" codec can´t decode byte 0x81 in position 7823: character maps to (undefined)
For what I could find, it seems to be a problem with the "latin" encoding of the csv file.
Inspecting the csv, I don´t see nothing special about the specific row where it get´s the error. I´m able to import about 2200 rows before this one, all with latin characters.
Any clues?
python django unicode
asked Nov 23 '18 at 18:57
Francisco GhelfiFrancisco Ghelfi
8712
I´m trying to import data from a csv file to a Django model. I´m using the manage.py shell for it with the following code:
>>> import csv
>>> import os
>>> path = "C:\UsersLia LoveDownloads"
>>> os.chdir(path)
>>> from catalog.models import ProductosBase
>>> with open('FarmaciasGob.csv') as csvfile:
... reader = csv.DictReader(csvfile)
... for row in reader:
... p = Country(country=row['Country'], continent=row['Continent'])
... p.save()
...
>>>
>>> exit()
I get the following error message at a given point of the dataset:
UnicodeDecodeError: "charmap" codec can´t decode byte 0x81 in position 7823: character maps to (undefined)
For what I could find, it seems to be a problem with the "latin" encoding of the csv file.
Inspecting the csv, I don´t see nothing special about the specific row where it get´s the error. I´m able to import about 2200 rows before this one, all with latin characters.
Any clues?
python django unicode
python django unicode
asked Nov 23 '18 at 18:57
Francisco GhelfiFrancisco Ghelfi
8712
asked Nov 23 '18 at 18:57
Francisco GhelfiFrancisco Ghelfi
8712
asked Nov 23 '18 at 18:57
Francisco GhelfiFrancisco Ghelfi
8712
asked Nov 23 '18 at 18:57
Francisco GhelfiFrancisco Ghelfi
8712
asked Nov 23 '18 at 18:57
Francisco GhelfiFrancisco Ghelfi
8712
8712
This is an issue with encoding are you using python2 or python3?
– 2ps
Nov 23 '18 at 19:10
Using Python 3.7.0
– Francisco Ghelfi
Nov 23 '18 at 19:12
add a comment |
This is an issue with encoding are you using python2 or python3?
– 2ps
Nov 23 '18 at 19:10
Using Python 3.7.0
– Francisco Ghelfi
Nov 23 '18 at 19:12
This is an issue with encoding are you using python2 or python3?
– 2ps
Nov 23 '18 at 19:10
This is an issue with encoding are you using python2 or python3?
– 2ps
Nov 23 '18 at 19:10
Using Python 3.7.0
– Francisco Ghelfi
Nov 23 '18 at 19:12
Using Python 3.7.0
– Francisco Ghelfi
Nov 23 '18 at 19:12
add a comment |
1 Answer
1
active
oldest
votes
Assuming you are in python3, this is an issue of the character encoding of your file. Most likely, the encoding is 'utf-8', but it could also be 'utf-16', 'utf-16le', 'cp1252', or 'cp437', all of which are also commonly used. In python3, you can specify the encoding of the file on the open:
with open('FarmaciasGob.csv', encoding='utf-8') as csvfile:
answered Nov 23 '18 at 19:12
2ps2ps
7,8872931
It worked perfectly with encoding="latin-1". Thanks @2ps
– Francisco Ghelfi
Nov 23 '18 at 19:56
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53451752%2ferror-importing-data-to-a-model-in-django%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Assuming you are in python3, this is an issue of the character encoding of your file. Most likely, the encoding is 'utf-8', but it could also be 'utf-16', 'utf-16le', 'cp1252', or 'cp437', all of which are also commonly used. In python3, you can specify the encoding of the file on the open:
with open('FarmaciasGob.csv', encoding='utf-8') as csvfile:
answered Nov 23 '18 at 19:12
2ps2ps
7,8872931
It worked perfectly with encoding="latin-1". Thanks @2ps
– Francisco Ghelfi
Nov 23 '18 at 19:56
add a comment |
Assuming you are in python3, this is an issue of the character encoding of your file. Most likely, the encoding is 'utf-8', but it could also be 'utf-16', 'utf-16le', 'cp1252', or 'cp437', all of which are also commonly used. In python3, you can specify the encoding of the file on the open:
with open('FarmaciasGob.csv', encoding='utf-8') as csvfile:
answered Nov 23 '18 at 19:12
2ps2ps
7,8872931
It worked perfectly with encoding="latin-1". Thanks @2ps
– Francisco Ghelfi
Nov 23 '18 at 19:56
add a comment |
Assuming you are in python3, this is an issue of the character encoding of your file. Most likely, the encoding is 'utf-8', but it could also be 'utf-16', 'utf-16le', 'cp1252', or 'cp437', all of which are also commonly used. In python3, you can specify the encoding of the file on the open:
with open('FarmaciasGob.csv', encoding='utf-8') as csvfile:
answered Nov 23 '18 at 19:12
2ps2ps
7,8872931
Assuming you are in python3, this is an issue of the character encoding of your file. Most likely, the encoding is 'utf-8', but it could also be 'utf-16', 'utf-16le', 'cp1252', or 'cp437', all of which are also commonly used. In python3, you can specify the encoding of the file on the open:
with open('FarmaciasGob.csv', encoding='utf-8') as csvfile:
answered Nov 23 '18 at 19:12
2ps2ps
7,8872931
answered Nov 23 '18 at 19:12
2ps2ps
7,8872931
answered Nov 23 '18 at 19:12
2ps2ps
7,8872931
answered Nov 23 '18 at 19:12
2ps2ps
7,8872931
7,8872931
It worked perfectly with encoding="latin-1". Thanks @2ps
– Francisco Ghelfi
Nov 23 '18 at 19:56
add a comment |
It worked perfectly with encoding="latin-1". Thanks @2ps
– Francisco Ghelfi
Nov 23 '18 at 19:56
It worked perfectly with encoding="latin-1". Thanks @2ps
– Francisco Ghelfi
Nov 23 '18 at 19:56
It worked perfectly with encoding="latin-1". Thanks @2ps
– Francisco Ghelfi
Nov 23 '18 at 19:56
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53451752%2ferror-importing-data-to-a-model-in-django%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
This is an issue with encoding are you using python2 or python3?
– 2ps
Nov 23 '18 at 19:10
Using Python 3.7.0
– Francisco Ghelfi
Nov 23 '18 at 19:12