SAUK Discussion Board

Go Back   SAUK Discussion Board > Board Management > The Garage
Join! Blogs FAQ Calendar Search Today's Posts Mark Forums Read

Notices

Reply  Post New Thread
 
Thread Tools
  #31  
Old 13th August 2019, 04:42
Sisyphus Sisyphus is offline
Member
 
Join Date: Aug 2012
Location: Lost
Posts: 272
Blog Entries: 1
Default Re: ***8217 ***8221

Something still doesn't ring true to me. My brain will gnaw on this when it could be spending time not gnawing on it.
Reply With Quote
  #32  
Old 13th August 2019, 05:31
Schmosby Schmosby is offline
Member
 
Join Date: Jan 2012
Location: London
Posts: 3,863
Blog Entries: 1

Mood
Relaxed

Default Re: ***8217 ***8221

This is how it's stored in the database
Code:
The prime minister’s official spokesman said Johnson remained “very clear in his determination to get a deal”
This is how it's displayed on the site with the setting commented out
Code:
The prime minister�s official spokesman said Johnson remained �very clear in his determination to get a deal�
This is how it's displayed on the site with the setting active
Code:
The prime minister’s official spokesman said Johnson remained “very clear in his determination to get a deal”
Reply With Quote
  #33  
Old 13th August 2019, 13:08
Sisyphus Sisyphus is offline
Member
 
Join Date: Aug 2012
Location: Lost
Posts: 272
Blog Entries: 1
Default Re: ***8217 ***8221

Ok, let me think on that.

I can see now that the database could still be ISO-8859-1 if the database engine did the translation to and from UTF-8 at its boundary. That could cause what I see.

This translation would happen closer to the database than the swear filter and so the '***' will not be caught as it isn't in the UTF-8 datastream.

You say “ is stored in the database. If it is ISO-8859-1 then it must be stored as Unicode in some way as “ isn't in ISO-8859-1. Can you see the raw data as, say, a hex string?
Reply With Quote
  #34  
Old 13th August 2019, 15:16
Schmosby Schmosby is offline
Member
 
Join Date: Jan 2012
Location: London
Posts: 3,863
Blog Entries: 1

Mood
Relaxed

Default Re: ***8217 ***8221

Did a bit more digging and it gets weird.

The data in the database is stored as both Windows-1252 from prior to switching to UTF-8 and UTF-8 thereafter. If I turn on the setting both data stored as Windows-1252 and UTF-8 in the database is displayed correctly on the site however any new posts made are converted to Windows-1252 with any characters outside the set being saved and displayed as ?, so indeed this isn't the solution.

I'm thinking now the easiest option would be to just leave the encodings all as they were originally and just remove the &# from the swear filter, but then again the Go Advanced doesn't convert them. Outside that I guess converting the previous Windows-1252 characters to UTF-8 in the database somehow...or I guess just leaving them broken .

UPDATE: It's actually even weirder...

If I make a new post I get:


If I refresh the page once, I still get the above, but If I refresh the page a second time I get:


Anyway, I give up, it's all too weird. I hope you work it out without your brain exploding
Reply With Quote
  #35  
Old 13th August 2019, 16:27
biscuits biscuits is offline
Member
 
Join Date: Jul 2005
Location: in the tin.
Posts: 18,195
Default Re: ***8217 ***8221

are we all seeing this now?


Reply With Quote
  #36  
Old 13th August 2019, 16:33
Indigo_ Indigo_ is offline
Co-Administrator
 
Join Date: May 2013
Location: Cheshire
Posts: 19,438
Default Re: ***8217 ***8221

^ Indeed we are! Apparently the question mark in the diamond will only show up on old posts and not new ones
Reply With Quote
  #37  
Old 13th August 2019, 17:57
Sisyphus Sisyphus is offline
Member
 
Join Date: Aug 2012
Location: Lost
Posts: 272
Blog Entries: 1
Default Re: ***8217 ***8221

^^^ I like weird; for some reason.

It was in interesting diversion from the daily grind but there is a limit to what we can do and deduce from the outside. Dropping the subject would probably be best and the issue will soon be forgotten.
Reply With Quote
  #38  
Old 13th August 2019, 20:22
Schmosby Schmosby is offline
Member
 
Join Date: Jan 2012
Location: London
Posts: 3,863
Blog Entries: 1

Mood
Relaxed

Default Re: ***8217 ***8221

Reply With Quote
  #39  
Old 14th August 2019, 10:01
Indigo_ Indigo_ is offline
Co-Administrator
 
Join Date: May 2013
Location: Cheshire
Posts: 19,438
Default Re: ***8217 ***8221

^ ha! I want to use this.
Reply With Quote
  #40  
Old 18th August 2019, 09:52
biscuits biscuits is offline
Member
 
Join Date: Jul 2005
Location: in the tin.
Posts: 18,195
Default Re: ***8217 ***8221

^^ haha that's great, I loike that!

For 99p a month you can subscribe to
Reply With Quote
Reply

Thread Tools

Forum Jump


All times are GMT +1. The time now is 20:04.


SAUK Award
Logo designed by abc
Powered by vBulletin
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.